-- Logs begin at Fri 2022-08-26 14:53:01 UTC, end at Fri 2022-08-26 16:13:55 UTC. -- Aug 26 15:41:05.989964 dv-cinder-831247-24-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 15:41:05.998786 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 15:41:06.000810 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 15:41:05 2022] *** Aug 26 15:41:06.000810 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 15:41:06.000810 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 15:41:06.000810 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: nodename: dv-cinder-831247-24-iscsi Aug 26 15:41:06.000810 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: machine: x86_64 Aug 26 15:41:06.000810 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: clock source: unix Aug 26 15:41:06.000810 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: pcre jit disabled Aug 26 15:41:06.000810 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: detected number of CPU cores: 4 Aug 26 15:41:06.000810 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: current working directory: / Aug 26 15:41:06.000810 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: detected binary path: /usr/bin/uwsgi-core Aug 26 15:41:06.001522 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: your processes number limit is 47680 Aug 26 15:41:06.001522 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: your memory page size is 4096 bytes Aug 26 15:41:06.001522 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: detected max file descriptor number: 2048 Aug 26 15:41:06.001522 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: lock engine: pthread robust mutexes Aug 26 15:41:06.001522 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: thunder lock: enabled Aug 26 15:41:06.001522 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 15:41:06.001522 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 15:41:06.040747 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: Python main interpreter initialized at 0x55b280b8a9c0 Aug 26 15:41:06.040747 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: python threads support enabled Aug 26 15:41:06.040747 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: your server socket listen backlog is limited to 100 connections Aug 26 15:41:06.040747 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: your mercy for graceful operations on workers is 90 seconds Aug 26 15:41:06.041137 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 15:41:06.041214 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: *** Operational MODE: preforking *** Aug 26 15:41:06.041436 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: *** uWSGI is running in multiple interpreter mode *** Aug 26 15:41:06.041436 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: spawned uWSGI master process (pid: 112678) Aug 26 15:41:06.041648 dv-cinder-831247-24-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 15:41:06.043104 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: spawned uWSGI worker 1 (pid: 112679, cores: 1) Aug 26 15:41:06.043104 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: spawned uWSGI worker 2 (pid: 112680, cores: 1) Aug 26 15:41:06.043104 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 15:41:06.719052 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 15:41:06.782850 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 15:41:07.801139 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:41:07.801139 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: from cryptography.utils import int_from_bytes Aug 26 15:41:07.801756 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:41:07.801756 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: from cryptography.utils import int_from_bytes Aug 26 15:41:07.860692 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:41:07.860692 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: from cryptography.utils import int_from_bytes Aug 26 15:41:07.861246 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:41:07.861246 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: from cryptography.utils import int_from_bytes Aug 26 15:41:10.277596 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 15:41:10.278163 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 15:41:10.278365 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 15:41:10.278714 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 15:41:10.278968 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 15:41:10.279351 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.279673 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.280016 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.280334 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.280658 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.280922 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 15:41:10.281294 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.281388 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 15:41:10.281468 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.281571 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.281709 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 15:41:10.281894 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.282074 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 15:41:10.282168 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.282337 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 15:41:10.282440 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.282730 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.282835 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-24-iscsi {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.283052 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.283150 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.283357 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.283445 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.284200 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.284290 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.284517 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.284603 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.284817 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.284913 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.285135 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.285241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.285434 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.285529 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.285862 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.286022 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.286126 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.286433 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.286561 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.286762 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-24-iscsi {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.286892 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.287086 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.287210 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.287401 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.287539 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.287716 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.287817 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.288069 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.288178 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.288377 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.288463 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.288683 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.288779 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.288995 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.289088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.289297 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.289507 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.289702 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-24-iscsi {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.289842 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.290017 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.290105 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.290328 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.290415 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.290640 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.290737 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.291042 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.291127 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.291347 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.291433 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.291651 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.291750 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.291986 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.292077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.292307 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.292394 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.292614 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.292777 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.292939 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.293034 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-24-iscsi {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.293256 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.293359 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.293571 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.293659 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.293885 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.293983 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.294184 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.294327 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.294488 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.294640 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.294794 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.294952 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.295109 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.295282 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.295417 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.295610 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.295734 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.295946 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.296043 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.296255 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.296349 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.296571 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.296680 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.296890 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.296993 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.297206 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.297308 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.297473 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.297566 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.297747 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.297857 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.298018 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.298116 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.298318 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.298412 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.298618 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.298725 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.298921 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.299030 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.299765 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.299891 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.300089 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.300194 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.300392 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.300491 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.300694 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.300790 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.300997 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.301093 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.301298 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.301391 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.301550 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.301728 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.301874 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.301971 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.302197 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.302292 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.302752 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.302897 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.303063 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.303149 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.303375 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.303463 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.303683 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.303785 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.304009 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.304099 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.304319 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.304407 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.304630 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.304732 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.304939 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.305033 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.305262 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.305371 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.305585 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.305692 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.305909 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.306044 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.306221 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.306357 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.306544 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.306714 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.306944 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.307062 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.307199 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.307434 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.307531 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.307769 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.307960 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.308088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.308177 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.308447 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.308535 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.308784 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.308870 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.309111 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.309213 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.309423 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.309518 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.309734 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.309831 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.310042 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.310186 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.310364 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.310587 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.310736 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.310958 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.311044 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.311289 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.311387 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.311593 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.311688 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.311923 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.312092 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.312249 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.312478 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.312573 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.312820 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.312908 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.313149 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.313246 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.313452 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.313539 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.313761 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.313848 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.314070 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.314165 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.314381 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.314475 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.314684 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.314770 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.315010 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.315110 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.315316 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.315409 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.315621 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.315736 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.315948 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.316059 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.316258 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.316350 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.316561 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.316662 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.316877 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.316985 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.317181 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.317273 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.317486 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.317585 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.317794 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.317922 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.318098 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.318188 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.318398 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.318491 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.318710 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.318811 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.319002 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.319098 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.319303 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.319437 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.319614 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.319721 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.319937 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.320044 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.320244 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.320338 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.320544 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.320636 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.320843 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.320936 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.321159 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.321252 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.321468 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.321562 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.321742 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.321835 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.322042 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.322136 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.322339 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.322440 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.322647 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.322738 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.322954 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.323068 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.323257 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.323356 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.323559 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.323651 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.323860 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.323980 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.324185 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.324278 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.324493 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.324586 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.324794 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.324896 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.325114 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.325207 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.325439 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.325532 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.325753 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.325855 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.326062 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.326155 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.326370 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.326463 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.326678 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.326770 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:41:10.326989 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.327088 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.327316 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.327409 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.327624 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.327717 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.327955 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.328062 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.328267 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.328361 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.328582 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.328675 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.328897 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.328989 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.329222 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.329322 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.329538 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.329633 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.329850 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.329943 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.330166 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.330354 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.330512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.330626 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.330827 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.330917 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.331150 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.331238 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.331471 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.331607 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.331779 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.331886 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.332142 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.332241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.332460 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.332555 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.332785 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.332874 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.333100 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.333255 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.333416 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.333509 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.333728 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.333823 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.334039 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.334136 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.334347 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.334442 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.334667 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.334754 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.334994 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.335091 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.335305 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.335394 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.335624 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.335710 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.335962 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.336063 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.336279 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.336365 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.336588 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.336687 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.336901 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.336991 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.337214 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.337302 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.337528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.337615 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.337838 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.337936 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.338167 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.338266 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.338480 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.338571 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.338799 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.338891 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.339113 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.339204 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.339420 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.339565 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.339737 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.339835 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.340070 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.340160 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.340381 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.340478 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.340691 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.340777 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.340992 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.341092 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.341296 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.341396 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.341599 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.341688 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.341906 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.341993 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.342209 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.342305 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.342527 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.342613 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.342852 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.342938 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.343156 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.343257 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.343465 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.343565 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.343778 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.343892 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.344111 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.344207 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.344420 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.344508 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.344729 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.344814 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.345029 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.345116 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.345338 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.345425 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.345646 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.345741 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.346463 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.346563 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.346793 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.346945 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.347101 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.347268 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.347404 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.347587 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.347726 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.347926 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.348055 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.348247 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.348409 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.348576 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.348676 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.348893 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.348992 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.349205 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.349295 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.349536 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.349625 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.349854 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.349940 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.350165 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.350262 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.350475 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.350569 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.350787 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.350875 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.351096 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.351791 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.351929 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.352027 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.352109 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.352198 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.352278 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.352356 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.352449 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.352530 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.352656 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.352755 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.352957 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.353043 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.353264 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.353352 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.353568 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.353668 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.353870 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.353957 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.354170 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.354257 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.354477 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.354578 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.354782 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.354869 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.355084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.355171 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.355387 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.355476 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.355690 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.355779 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.356018 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.356109 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.356341 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.356431 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.356649 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.356755 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.356948 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.357037 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.357251 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.357347 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.357553 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.357641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.357879 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.357965 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.358189 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.358284 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.358508 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.358615 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.358814 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.358912 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.359141 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.359236 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.359456 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.359544 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.359766 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.359895 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.360096 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.360183 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.360404 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.360492 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.360712 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.360812 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.361025 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.361120 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.361336 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.361423 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.361711 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.362360 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.362535 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.362629 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.362856 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.362943 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.363166 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.363263 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.363603 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.363777 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.363940 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.364128 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.364266 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.364451 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.364571 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.364771 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.364888 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.365092 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.365227 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.365422 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.365558 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.365743 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.365873 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.366071 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.366195 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.366390 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.366505 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.366725 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.366832 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.367042 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.367139 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.367369 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.367464 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.367682 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.367769 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.368030 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.368122 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.368350 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.368449 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.368664 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.368770 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.368979 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.369068 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.369289 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.369376 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.369610 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.369698 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.369920 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.370008 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.370240 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.370328 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.370545 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.370633 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.370860 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.370956 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.371178 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.371266 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.371504 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.371599 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.371813 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.371914 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.372148 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.372246 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.372469 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.372566 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.372780 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.372867 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.373089 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.373176 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.373400 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.373496 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.373703 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.373790 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.374006 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.374094 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.374314 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.374414 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.374629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.374717 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.374938 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.375026 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.375246 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.375342 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.375549 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.375643 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.375861 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.375979 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.376191 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.376280 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.376493 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.376580 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.376799 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.376927 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.377112 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.377202 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.377452 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.377552 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.377767 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.377859 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.378081 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.378172 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.378395 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.378494 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.378700 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.378792 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.379003 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.379096 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.379322 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.379413 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.379627 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.379728 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.379980 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.380072 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.380294 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.380400 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.380592 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.380694 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.380927 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.381020 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.381235 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.381326 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.381538 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.381640 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.381851 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.381945 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.382161 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.382253 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.382515 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.382626 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.382779 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.382867 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.383088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.383180 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.383394 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.383485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.383722 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.383817 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.384038 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.384130 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.384346 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.384438 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.384652 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.384745 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.384957 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.385049 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.385263 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.385350 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.385575 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.385663 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.385890 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.385983 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.386196 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.386288 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.386501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.386594 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.386806 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.386913 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.387105 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.387198 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.387409 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.387502 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.387727 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.387831 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.388067 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.388321 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.388432 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.388651 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.388749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.388963 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.389060 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.389281 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.389378 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.389597 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.389701 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.389913 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.390028 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.390224 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.390330 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.390540 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.390637 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.390862 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.390966 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.391166 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.391435 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.391532 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.391762 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.391887 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.392090 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.392188 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.392399 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.392508 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.392718 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.392834 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.393025 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.393130 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.393327 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.393432 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.393634 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.393730 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.393936 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.394034 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.394238 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.394335 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.394540 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.394645 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.394842 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.394939 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.395154 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.395250 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.395456 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.395552 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.395763 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.395861 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.396090 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.396187 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.396415 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.396529 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.396738 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.396838 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.397023 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.397127 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.397325 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.397431 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.397628 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.397733 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.397936 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.398063 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.398260 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.398365 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.398573 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.398662 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.398894 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.398997 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.399206 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.399312 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.399522 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.399629 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.399826 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.399952 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.400158 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.400271 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.400463 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.400567 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.400769 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.400864 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.401069 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.401164 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.401378 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.401474 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.401689 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.401790 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.401976 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.402075 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.402285 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.402381 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.402593 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.402689 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.402909 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.402995 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.403199 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.403303 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.403501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.403598 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.403810 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.403943 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.404137 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.404277 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.404448 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.404596 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.404756 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.404894 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.405058 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.405203 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.405360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.405506 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.405652 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.405788 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.405961 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.406096 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.406263 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.406414 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.406570 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.406716 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.406860 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.406994 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.407175 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.407322 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.407475 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.407612 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.407773 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.407930 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.408100 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.408247 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.408409 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.409034 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.409232 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.409368 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.409584 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.409722 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.409858 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.410002 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.410138 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.410271 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.410416 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.410550 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.410711 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.410849 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.411016 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.411154 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.411302 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.411449 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.411607 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.411740 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.411936 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.412085 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.412253 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.412394 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.412563 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.412696 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.412848 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.413056 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.413197 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.413331 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.413470 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.413616 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.413752 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.413907 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.414044 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.414178 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.414314 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.414451 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.414587 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.414729 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.414864 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.414999 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.415163 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.415302 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.415445 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.415583 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.415734 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.415897 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.416087 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.416229 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.416381 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.416517 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.416681 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.416818 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.416983 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.417122 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.417266 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.417403 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.417607 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.417754 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.417909 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.418046 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.418272 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.418411 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.418577 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.418715 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.418888 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.419062 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.419220 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.419356 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.419494 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.419641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.419786 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.419985 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.420118 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.420255 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.420412 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.420546 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.420728 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.420870 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.421035 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.421186 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.421346 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.421498 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.421649 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.421799 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.421940 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.422078 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.422216 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.422354 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.422529 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.422686 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.422825 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.422965 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.423198 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.423352 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.423502 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.423653 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.423792 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.423959 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.424137 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.424786 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.424946 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.425089 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.425228 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.425366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.425512 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.425660 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.425809 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.425948 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.426099 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.426246 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.426393 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.426541 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.426689 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.426829 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.426968 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.427145 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.427299 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.427725 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.427937 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.428087 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.428238 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.428377 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.428516 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.428665 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.428813 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.428977 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.429123 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.429292 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.429438 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.429586 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.429725 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.429872 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.430012 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.430161 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.430308 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.430462 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.430612 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.430753 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.430899 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.431039 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.431186 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.431411 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.431556 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.431728 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.431914 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.432061 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.432223 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.432365 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.432504 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.432649 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.432788 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.432953 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.433113 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.433340 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.433487 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.433626 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.433765 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.433913 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.434077 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.434218 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.434382 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.434523 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.434668 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.434820 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.434971 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.435111 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.435250 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.435395 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.435535 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.435681 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.435821 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.436046 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.436200 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.436341 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.436480 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.436628 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.436768 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.436914 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.437061 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.437200 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.437347 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.437496 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.437718 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.437866 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.438016 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.438155 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.438374 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.438516 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.438657 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.438796 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.438934 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.439073 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.439221 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.439437 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.439586 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.439771 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.439946 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.440106 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.440259 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.440399 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.440537 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.440716 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.440863 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.441036 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.441185 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.441332 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.441471 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.441634 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.441790 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.441950 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.442091 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.442256 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.442410 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.442551 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.442697 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.442839 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.443090 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.443247 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.443481 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.443630 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.443770 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.443939 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.444098 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.444251 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.444399 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.444539 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.444677 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.444815 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.444955 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.445108 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.445259 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.445399 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.445565 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.445720 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.445893 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.446065 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.446207 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.446346 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.446520 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.446667 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.446842 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.446991 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.447153 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.447299 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.447439 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.447578 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.447726 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.447921 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.448072 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.448211 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.448350 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.448537 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.448768 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.448952 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.449100 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.449241 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.449380 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.449528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.449668 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.449814 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.449966 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.450135 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.450282 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.450430 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.450571 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.450741 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.450896 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.451037 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.451177 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.451356 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.451511 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.451660 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.451802 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.451984 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.452138 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.452289 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.452430 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.452569 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.452708 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.452854 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.453004 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.453144 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.453292 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.453431 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.453660 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.453805 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.453965 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.454113 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.454256 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.454408 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.454556 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.454703 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.454853 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.454994 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.455132 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.455271 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.455979 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.456127 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.456293 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.456435 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.456582 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.456746 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.456893 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.457065 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.457222 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.457391 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.457546 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.457687 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.457824 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.457976 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.458115 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.458286 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.458434 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.458582 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.458722 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.458870 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.459018 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.459165 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.459312 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.459476 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.459624 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.459772 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.459941 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.460098 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.460249 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.460397 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.460551 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.460693 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.460839 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.460983 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.461159 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.461306 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.461492 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.461642 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.461804 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.461961 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.462103 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.462260 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.462409 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.462549 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.462711 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.462859 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.463021 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.463169 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.463317 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.463457 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.463709 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.463931 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.464094 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.464256 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.464398 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.464549 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.464690 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.464837 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.464977 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.465130 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.465271 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.465409 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.465555 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.465695 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.465835 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.465987 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.466140 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.466280 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.466419 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.466558 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.466696 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.466849 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.466990 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.467127 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.467273 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.467411 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.467593 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.467804 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.467985 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.468163 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.468322 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.468464 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.468612 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.468792 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.468947 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.469096 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.469236 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.469409 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.469571 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.469712 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.469858 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.470008 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.470149 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.470321 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.470478 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.470619 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.470767 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.470937 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.471126 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.471284 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.471439 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.471604 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.471753 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.471952 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.472293 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.472452 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.472593 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.472733 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.472912 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.473060 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.473227 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.473383 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.473524 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.473664 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.473887 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.474032 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.474198 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.474341 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.474479 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.474618 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.474764 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.474913 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.475065 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.475206 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.475369 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.475516 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.475679 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.475839 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.476020 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.476160 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.476300 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.476439 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.476613 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.476773 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.476915 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.477055 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.477221 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.477368 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.477537 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.477766 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.477919 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.478059 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.478198 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.478336 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.478489 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.478648 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.478789 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.478928 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.479067 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.479205 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.479382 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.479532 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.479686 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.479826 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.480133 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.480289 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.480444 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.480592 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.480761 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.480915 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.481083 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.481244 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.481392 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.481543 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.481706 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.481863 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.482028 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.482184 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.482350 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.482498 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.482638 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.482783 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.482923 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.483071 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.483234 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.483381 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.483542 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.483700 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.483848 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.484051 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.484193 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.484333 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.484471 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.484758 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.484917 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.485082 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.485227 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.485388 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.485541 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.485742 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.485907 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.486074 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.486250 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.486397 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.487092 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.487250 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.487402 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.487566 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.487714 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.487902 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.488055 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.488213 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.488365 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.488527 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.488683 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.488831 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.488979 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.489132 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.489274 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.489453 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.489601 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.489774 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.489922 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.490072 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.490213 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.490395 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.490542 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.490689 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.490829 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.490982 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.491234 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.491383 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.491580 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.491727 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.491927 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.492083 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.492235 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.492375 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.492536 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.492677 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.492823 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.492963 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.493104 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.493243 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.493382 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.493520 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.493667 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.493808 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.493947 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.494093 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.494234 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.494383 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.494536 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.494676 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.494823 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.494973 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.495113 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.495286 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.495442 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.495605 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.495752 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.495930 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.496078 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.496241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.496383 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.496523 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.496662 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.496835 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.496983 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.497166 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.497323 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.497469 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.497621 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.497775 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.497921 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.498075 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.498269 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.498420 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.498573 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.498720 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.498874 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.499020 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.499165 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.499310 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.499455 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.499608 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.499769 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.499964 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.500119 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.500275 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.500449 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.500612 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.500772 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.500917 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.501062 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.501207 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.501351 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.501496 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.501720 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.501872 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.502025 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.502221 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.502387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.502544 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.502692 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.502850 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.502997 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.503149 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.503296 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.503448 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.503605 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.503752 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.503925 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.504088 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.504255 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.504412 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.504566 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.504713 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.504872 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.505019 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.505164 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.505318 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.505464 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.505640 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.505791 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.505945 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.506100 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.506258 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.506404 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.506556 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.506702 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.506860 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.507085 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.507235 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.507380 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.507526 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.507678 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.507826 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.508046 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.508206 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.508351 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.508496 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.508641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.508795 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.508952 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.509106 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.509252 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.509397 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.509541 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.509694 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.509844 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.509989 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.510152 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.510306 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.510452 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.510606 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.510758 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.510914 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.511064 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.511216 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.511371 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.511525 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.511685 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.511831 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.512013 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.512170 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.512329 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.512484 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.512630 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.512775 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.512929 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.513078 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.513232 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.513386 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.513533 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.513686 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.513844 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.513997 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.514153 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.514299 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.514443 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.514596 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.514742 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.514900 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.515047 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.515193 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.515345 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.515491 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.515635 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.515803 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.516012 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.516113 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.516201 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.516296 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.516462 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.516594 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.516773 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.516902 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.517200 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.517291 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.517513 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.517603 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.518324 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.518419 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.518631 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.518719 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.518941 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.519036 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.519249 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.519347 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.519552 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.519640 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.519858 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.520045 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.520204 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.520362 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.520511 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.520666 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.520814 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.520966 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.521112 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.521257 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.521403 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.521562 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.521711 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.521856 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.522002 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.522158 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.522304 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.522458 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.522605 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.522751 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.522895 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.523040 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.523194 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.523340 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.523485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.523631 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.523775 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.523966 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.524129 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.524276 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.524421 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.524567 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.524711 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.524866 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.525023 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.525177 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.525323 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.525467 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.525614 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.525758 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.525923 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.526069 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.526221 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.526375 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.526521 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.526675 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.526822 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.526967 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.527111 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.527256 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.527401 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.527554 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.527746 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.527932 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.528086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.528243 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.528389 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.528543 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.528696 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.528844 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.528989 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.529134 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.529279 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.529432 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.529631 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.529801 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.529950 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.530095 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.530248 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.530394 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.530548 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.530694 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.530838 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.530984 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.531139 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.531286 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.531439 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.531585 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.531746 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.531944 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.532111 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.532258 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.532403 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.532556 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.532702 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.532856 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.533013 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.533159 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.533311 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.533514 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.533687 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.533848 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.533997 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.534150 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.534296 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.534441 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.534587 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.534740 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.534898 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.535045 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.535190 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.535335 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.535479 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.535710 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.535858 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.536033 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.536180 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.536325 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.536482 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.536629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.536784 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.536931 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.537083 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.537238 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.537394 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.537551 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.537697 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.537843 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.537987 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.538138 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.538297 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.538444 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.538597 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.538752 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.538906 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.539061 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.539207 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.539354 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 15:41:10.539510 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.539656 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.539860 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.540208 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.540525 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.540847 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.541168 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.541502 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.541834 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.542154 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.542489 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.542822 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.543180 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.543502 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.543853 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.544214 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.544536 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.544855 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.545167 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:41:10.545416 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 15:41:10.694999 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO dbcounter [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Registered counter for database nova_api Aug 26 15:41:10.699967 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO dbcounter [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] Registered counter for database nova_api Aug 26 15:41:10.716875 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_db.sqlalchemy.engines [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:41:10.720433 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG oslo_db.sqlalchemy.engines [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:41:10.723704 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG dbcounter [-] [112680] Writer thread running {{(pid=112680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:41:10.727295 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG dbcounter [-] [112679] Writer thread running {{(pid=112679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:41:10.779317 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.context [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),739d7cf6-45f9-4f1f-972a-0b17316ed928(cell1) {{(pid=112680) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 15:41:10.783089 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:41:10.783596 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:41:10.783994 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.context [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),739d7cf6-45f9-4f1f-972a-0b17316ed928(cell1) {{(pid=112679) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 15:41:10.785209 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:41:10.785932 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:41:10.786369 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:41:10.788167 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG oslo_concurrency.lockutils [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:41:10.788353 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:41:10.788771 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG oslo_concurrency.lockutils [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:41:10.790327 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO dbcounter [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Registered counter for database nova_cell0 Aug 26 15:41:10.790461 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG oslo_concurrency.lockutils [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:41:10.791276 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG oslo_concurrency.lockutils [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:41:10.791732 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG oslo_concurrency.lockutils [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:41:10.793738 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG oslo_concurrency.lockutils [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:41:10.795735 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO dbcounter [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Registered counter for database nova_cell1 Aug 26 15:41:10.795843 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO dbcounter [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] Registered counter for database nova_cell0 Aug 26 15:41:10.801980 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO dbcounter [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] Registered counter for database nova_cell1 Aug 26 15:41:10.804082 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_db.sqlalchemy.engines [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:41:10.806721 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_db.sqlalchemy.engines [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:41:10.809806 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG oslo_db.sqlalchemy.engines [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:41:10.811180 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG dbcounter [-] [112680] Writer thread running {{(pid=112680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:41:10.811880 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG oslo_db.sqlalchemy.engines [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:41:10.819776 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG dbcounter [-] [112679] Writer thread running {{(pid=112679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:41:10.820155 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG dbcounter [-] [112679] Writer thread running {{(pid=112679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:41:10.951758 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG dbcounter [-] [112680] Writer thread running {{(pid=112680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:41:10.961800 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO dbcounter [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Registered counter for database nova_cell0 Aug 26 15:41:10.965539 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO dbcounter [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] Registered counter for database nova_cell0 Aug 26 15:41:10.971531 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_db.sqlalchemy.engines [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:41:10.973232 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG oslo_db.sqlalchemy.engines [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:41:10.976473 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG dbcounter [-] [112680] Writer thread running {{(pid=112680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:41:10.977590 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG dbcounter [-] [112679] Writer thread running {{(pid=112679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:41:11.390428 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: WARNING keystonemiddleware.auth_token [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:41:11.398024 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: WARNING keystonemiddleware.auth_token [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:41:11.405434 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: WARNING keystonemiddleware.auth_token [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:41:11.412938 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: WARNING keystonemiddleware.auth_token [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:41:11.744254 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: WARNING keystonemiddleware.auth_token [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:41:11.750270 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: WARNING keystonemiddleware.auth_token [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:41:11.756088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b280b8a9c0 pid: 112680 (default app) Aug 26 15:41:11.758181 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:41:11.758488 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: WARNING keystonemiddleware.auth_token [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:41:11.759391 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] 10.222.0.98 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001756 Aug 26 15:41:11.759807 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 1/1] 10.222.0.98 () {50 vars in 788 bytes} [Fri Aug 26 15:41:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:41:11.764787 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: WARNING keystonemiddleware.auth_token [None req-0817a461-51b7-4401-a115-eefdc4805a4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:41:11.770782 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b280b8a9c0 pid: 112679 (default app) Aug 26 15:42:34.332963 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:42:34.334080 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 26 15:42:34.334570 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 2/2] 10.222.0.98 () {54 vars in 931 bytes} [Fri Aug 26 15:42:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:42:34.347252 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG dbcounter [-] [112679] Writing DB stats nova_api:SELECT=3 {{(pid=112679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:34.349201 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG dbcounter [-] [112679] Writing DB stats nova_cell1:SELECT=3 {{(pid=112679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:34.350667 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG dbcounter [-] [112679] Writing DB stats nova_cell0:SELECT=3 {{(pid=112679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:34.351840 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG dbcounter [-] [112679] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:35.396639 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-1a0729b1-5da9-4036-9e55-c4577b1a4b58 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:42:35.429590 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-1a0729b1-5da9-4036-9e55-c4577b1a4b58 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.088007 Aug 26 15:42:35.430330 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 1/3] 10.222.0.98 () {60 vars in 1292 bytes} [Fri Aug 26 15:42:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:42:37.908747 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:42:37.909764 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-02bde8f3-fd57-4e88-9b88-faca43cb905a None None] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 26 15:42:37.910331 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 3/4] 10.222.0.98 () {54 vars in 931 bytes} [Fri Aug 26 15:42:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:42:38.409633 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-1704cef8-9b20-4985-99fc-33e09f24a462 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256}} {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:42:38.546523 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-1704cef8-9b20-4985-99fc-33e09f24a462 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.629869 Aug 26 15:42:38.547289 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 2/5] 10.222.0.98 () {64 vars in 1283 bytes} [Fri Aug 26 15:42:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:42:38.561559 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG dbcounter [-] [112680] Writing DB stats nova_api:SELECT=3 {{(pid=112680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:38.562630 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG dbcounter [-] [112680] Writing DB stats nova_cell0:SELECT=3 {{(pid=112680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:38.563350 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG dbcounter [-] [112680] Writing DB stats nova_cell1:SELECT=3 {{(pid=112680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:38.564131 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG dbcounter [-] [112680] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:38.772883 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-71ec5d63-fe2b-41a4-9ca0-3de47cfb2846 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:42:38.933088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-71ec5d63-fe2b-41a4-9ca0-3de47cfb2846 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.376869 Aug 26 15:42:38.933988 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 4/6] 10.222.0.98 () {64 vars in 1336 bytes} [Fri Aug 26 15:42:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:42:41.299558 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-1704cef8-9b20-4985-99fc-33e09f24a462 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:42:41.300663 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-1704cef8-9b20-4985-99fc-33e09f24a462 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001806 Aug 26 15:42:41.301078 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 3/7] 10.222.0.98 () {54 vars in 931 bytes} [Fri Aug 26 15:42:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:42:41.968300 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-b3a7a9cd-7a90-48ad-be51-16f0f08331a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "disk": 5, "vcpus": 1, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:42:42.085985 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-b3a7a9cd-7a90-48ad-be51-16f0f08331a7 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.778034 Aug 26 15:42:42.086778 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 5/8] 10.222.0.98 () {64 vars in 1283 bytes} [Fri Aug 26 15:42:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:42:42.100847 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-2879bc28-b6ff-4e3b-822c-6339ec60b5ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:42:42.230290 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-2879bc28-b6ff-4e3b-822c-6339ec60b5ad admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.134051 Aug 26 15:42:42.236472 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 4/9] 10.222.0.98 () {64 vars in 1336 bytes} [Fri Aug 26 15:42:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:42:44.681680 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-b3a7a9cd-7a90-48ad-be51-16f0f08331a7 admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:42:44.682707 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-b3a7a9cd-7a90-48ad-be51-16f0f08331a7 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 26 15:42:44.683108 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 6/10] 10.222.0.98 () {54 vars in 931 bytes} [Fri Aug 26 15:42:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:42:45.089740 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-3135d297-04bb-4cd5-b8ca-2bfa07d28506 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:42:45.164359 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-3135d297-04bb-4cd5-b8ca-2bfa07d28506 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474548 Aug 26 15:42:45.164938 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 5/11] 10.222.0.98 () {64 vars in 1283 bytes} [Fri Aug 26 15:42:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:42:45.180559 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-c55fdd0a-02e6-403c-8d73-5212482d825a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:42:45.259489 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-c55fdd0a-02e6-403c-8d73-5212482d825a admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082553 Aug 26 15:42:45.260033 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 7/12] 10.222.0.98 () {64 vars in 1336 bytes} [Fri Aug 26 15:42:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:42:47.686297 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-3135d297-04bb-4cd5-b8ca-2bfa07d28506 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:42:47.687473 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-3135d297-04bb-4cd5-b8ca-2bfa07d28506 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Aug 26 15:42:47.688427 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 6/13] 10.222.0.98 () {54 vars in 931 bytes} [Fri Aug 26 15:42:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:42:48.105613 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-c5128835-fc9c-459d-b865-f924d511296a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:42:48.193229 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-c5128835-fc9c-459d-b865-f924d511296a admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.498160 Aug 26 15:42:48.193781 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 8/14] 10.222.0.98 () {64 vars in 1283 bytes} [Fri Aug 26 15:42:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:42:48.207098 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-07434a27-154b-4c0a-b8aa-02b92a5c5be2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:42:48.322595 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-07434a27-154b-4c0a-b8aa-02b92a5c5be2 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119209 Aug 26 15:42:48.323129 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 7/15] 10.222.0.98 () {64 vars in 1336 bytes} [Fri Aug 26 15:42:48 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:42:50.690325 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-c5128835-fc9c-459d-b865-f924d511296a admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:42:50.691395 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-c5128835-fc9c-459d-b865-f924d511296a admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 26 15:42:50.691797 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 9/16] 10.222.0.98 () {54 vars in 931 bytes} [Fri Aug 26 15:42:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:42:51.155158 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-fb98ff2d-7e93-4917-9406-1f3bdfe32a9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "ram": 4096}} {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:42:51.251274 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-fb98ff2d-7e93-4917-9406-1f3bdfe32a9c admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.553187 Aug 26 15:42:51.252641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 8/17] 10.222.0.98 () {64 vars in 1283 bytes} [Fri Aug 26 15:42:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:42:51.265437 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-36115a1d-e8e1-4d22-9ea6-82792822086f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:42:51.344889 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-36115a1d-e8e1-4d22-9ea6-82792822086f admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083238 Aug 26 15:42:51.345475 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 10/18] 10.222.0.98 () {64 vars in 1336 bytes} [Fri Aug 26 15:42:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:42:53.771023 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-fb98ff2d-7e93-4917-9406-1f3bdfe32a9c admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:42:53.772391 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-fb98ff2d-7e93-4917-9406-1f3bdfe32a9c admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001853 Aug 26 15:42:53.772938 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 9/19] 10.222.0.98 () {54 vars in 931 bytes} [Fri Aug 26 15:42:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:42:54.241639 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-f75159dd-bf19-4efe-8046-f1bd04dbe96b admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:42:54.268021 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-f75159dd-bf19-4efe-8046-f1bd04dbe96b admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.486375 Aug 26 15:42:54.268673 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 11/20] 10.222.0.98 () {60 vars in 1292 bytes} [Fri Aug 26 15:42:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:42:56.661623 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-fb98ff2d-7e93-4917-9406-1f3bdfe32a9c admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:42:56.662607 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-fb98ff2d-7e93-4917-9406-1f3bdfe32a9c admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 26 15:42:56.663017 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 10/21] 10.222.0.98 () {54 vars in 931 bytes} [Fri Aug 26 15:42:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:42:57.131971 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-b74ff3f3-a3f3-4bdd-85fe-e6abce9da8b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "name": "m1.tiny", "ram": 512}} {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:42:57.221060 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-b74ff3f3-a3f3-4bdd-85fe-e6abce9da8b8 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.551301 Aug 26 15:42:57.221594 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 12/22] 10.222.0.98 () {64 vars in 1283 bytes} [Fri Aug 26 15:42:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:42:57.234297 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-a12fe3a7-1cb8-4a46-a2e0-7562727a3aeb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:42:57.345055 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-a12fe3a7-1cb8-4a46-a2e0-7562727a3aeb admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114742 Aug 26 15:42:57.345554 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 11/23] 10.222.0.98 () {64 vars in 1333 bytes} [Fri Aug 26 15:42:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:42:59.706798 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-b74ff3f3-a3f3-4bdd-85fe-e6abce9da8b8 admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:42:59.707826 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-b74ff3f3-a3f3-4bdd-85fe-e6abce9da8b8 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 26 15:42:59.708463 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 13/24] 10.222.0.98 () {54 vars in 931 bytes} [Fri Aug 26 15:42:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:43:00.076412 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-fa272b6c-fe18-41fd-b288-28e1ed163f02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:43:00.169701 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-fa272b6c-fe18-41fd-b288-28e1ed163f02 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.455289 Aug 26 15:43:00.171463 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 12/25] 10.222.0.98 () {64 vars in 1283 bytes} [Fri Aug 26 15:42:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 15:43:00.183445 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-766a6a2c-843a-4fe9-98f6-0709906a026e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:43:00.293700 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-766a6a2c-843a-4fe9-98f6-0709906a026e admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113936 Aug 26 15:43:00.294278 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 14/26] 10.222.0.98 () {64 vars in 1333 bytes} [Fri Aug 26 15:43:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:43:02.681936 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-fa272b6c-fe18-41fd-b288-28e1ed163f02 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:02.684238 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-fa272b6c-fe18-41fd-b288-28e1ed163f02 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002125 Aug 26 15:43:02.684872 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 13/27] 10.222.0.98 () {54 vars in 931 bytes} [Fri Aug 26 15:43:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:43:03.141426 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-0048ad27-f266-4207-8a41-755a9a20d7b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "disk": 40, "rxtx_factor": 1.0, "swap": 0}} {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:43:03.243280 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-0048ad27-f266-4207-8a41-755a9a20d7b9 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.550904 Aug 26 15:43:03.243840 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 15/28] 10.222.0.98 () {64 vars in 1283 bytes} [Fri Aug 26 15:43:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:43:03.256375 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-79ec122a-afc0-4a63-a494-c47ffb1fc5fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:43:03.333983 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-79ec122a-afc0-4a63-a494-c47ffb1fc5fa admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081394 Aug 26 15:43:03.335224 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 14/29] 10.222.0.98 () {64 vars in 1333 bytes} [Fri Aug 26 15:43:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:43:05.786322 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-0048ad27-f266-4207-8a41-755a9a20d7b9 admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:05.787476 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-0048ad27-f266-4207-8a41-755a9a20d7b9 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Aug 26 15:43:05.787986 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 16/30] 10.222.0.98 () {54 vars in 931 bytes} [Fri Aug 26 15:43:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:43:06.234899 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-b103ad4a-2d57-4c31-b9ab-68fff32ce3bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:43:06.253158 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG dbcounter [-] [112679] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:06.351337 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-b103ad4a-2d57-4c31-b9ab-68fff32ce3bc admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.556474 Aug 26 15:43:06.357558 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 15/31] 10.222.0.98 () {64 vars in 1283 bytes} [Fri Aug 26 15:43:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:43:06.365360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-bd8baf10-21b7-4293-b91f-e599d491ebd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:43:06.467288 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-bd8baf10-21b7-4293-b91f-e599d491ebd8 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105833 Aug 26 15:43:06.472023 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 17/32] 10.222.0.98 () {64 vars in 1333 bytes} [Fri Aug 26 15:43:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:43:08.948806 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-b103ad4a-2d57-4c31-b9ab-68fff32ce3bc admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:08.950645 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-b103ad4a-2d57-4c31-b9ab-68fff32ce3bc admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002430 Aug 26 15:43:08.951282 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 16/33] 10.222.0.98 () {54 vars in 931 bytes} [Fri Aug 26 15:43:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:43:09.446346 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-67c6efa9-f0ef-48ee-9e16-7de05adae67c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:43:10.095578 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-67c6efa9-f0ef-48ee-9e16-7de05adae67c admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 1.137683 Aug 26 15:43:10.096361 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 18/34] 10.222.0.98 () {64 vars in 1283 bytes} [Fri Aug 26 15:43:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:43:10.109428 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-f1ac6062-06bc-4083-b893-e7af706fcfc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:43:10.208437 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-f1ac6062-06bc-4083-b893-e7af706fcfc4 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103404 Aug 26 15:43:10.209098 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 17/35] 10.222.0.98 () {64 vars in 1333 bytes} [Fri Aug 26 15:43:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:43:28.819377 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-67c6efa9-f0ef-48ee-9e16-7de05adae67c admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:28.820442 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-67c6efa9-f0ef-48ee-9e16-7de05adae67c admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 26 15:43:28.820858 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 19/36] 10.222.0.98 () {54 vars in 931 bytes} [Fri Aug 26 15:43:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:43:29.209024 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-dec874d0-c137-430c-af00-f31a1cb77a27 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:29.227995 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-dec874d0-c137-430c-af00-f31a1cb77a27 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400813 Aug 26 15:43:29.228544 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 18/37] 10.222.0.98 () {60 vars in 1292 bytes} [Fri Aug 26 15:43:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:43:30.287993 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-67c6efa9-f0ef-48ee-9e16-7de05adae67c admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:30.289020 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-67c6efa9-f0ef-48ee-9e16-7de05adae67c admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 26 15:43:30.289415 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 20/38] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Aug 26 15:43:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:43:30.837072 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-cf16d3bd-b6cf-468b-a9f9-422101f400ea admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:30.843233 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.wsgi [None req-cf16d3bd-b6cf-468b-a9f9-422101f400ea admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-cf16d3bd-b6cf-468b-a9f9-422101f400ea admin admin] Request method failure captured: Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Accept: application/json Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Accept-Encoding: gzip, deflate Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Connection: keep-alive Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Content-Length: 0 Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Host: 10.222.0.98 Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Openstack-Api-Version: compute 2.90 Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Openstack-System-Scope: None Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: User-Agent: python-novaclient Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Auth-Token: gAAAAABjCOoin3THnxlfE8QcGd2nhadKtToQcansq4JdCSq0X5_cYSt-wS1YeN9gwQVZeyVM5xAVSqto61Ng2M23RkuR9dPWTKY_yHvmXlwf03TRG1G1ASn59hzd1HhLyLC1u6R6YlbsYLekfJHCdMNfT4F6sMF1ok8F_wzNmwaT3Zaeau9waXc Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Domain-Id: None Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Domain-Name: None Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Identity-Status: Confirmed Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Is-Admin-Project: True Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Project-Domain-Id: default Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Project-Domain-Name: Default Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Project-Id: 86d26d8b55fb4a2b877ae676d9b1d379 Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Project-Name: admin Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Role: member,reader,admin Aug 26 15:43:30.846512 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Roles: member,reader,admin Aug 26 15:43:30.848189 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86d26d8b55fb4a2b877ae676d9b1d379"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86d26d8b55fb4a2b877ae676d9b1d379", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86d26d8b55fb4a2b877ae676d9b1d379"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86d26d8b55fb4a2b877ae676d9b1d379"}]}] Aug 26 15:43:30.848189 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Tenant: admin Aug 26 15:43:30.848189 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Tenant-Id: 86d26d8b55fb4a2b877ae676d9b1d379 Aug 26 15:43:30.848189 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Tenant-Name: admin Aug 26 15:43:30.848189 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-User: admin Aug 26 15:43:30.848189 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-User-Domain-Id: default Aug 26 15:43:30.848189 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-User-Domain-Name: Default Aug 26 15:43:30.848189 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-User-Id: 3fea9e7c5b754acaa0233c15976ac3b3 Aug 26 15:43:30.848189 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-User-Name: admin Aug 26 15:43:30.848189 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: method: > Aug 26 15:43:30.848189 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: exception: Flavor 42 could not be found. Aug 26 15:43:30.848189 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: action_args: {'id': '42'} Aug 26 15:43:30.848189 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:43:30.848189 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:43:30.849173 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Aug 26 15:43:30.850387 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-cf16d3bd-b6cf-468b-a9f9-422101f400ea admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:43:30.851605 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-cf16d3bd-b6cf-468b-a9f9-422101f400ea admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.406641 Aug 26 15:43:30.851605 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 19/39] 10.222.0.98 () {60 vars in 1190 bytes} [Fri Aug 26 15:43:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:30.857863 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-466bd2b5-f2e0-4218-892f-8234804b004b admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:30.862039 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG dbcounter [-] [112680] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:30.881095 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-466bd2b5-f2e0-4218-892f-8234804b004b admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026959 Aug 26 15:43:30.881631 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 21/40] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Aug 26 15:43:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:43:30.891911 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-bd68347b-3643-4636-9c01-5041c66528dc admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:30.916107 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-bd68347b-3643-4636-9c01-5041c66528dc admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027674 Aug 26 15:43:30.916699 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 20/41] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Aug 26 15:43:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:43:30.926992 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-280d9106-0367-4d2f-9f6a-2ca4214a410a admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:30.933666 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.wsgi [None req-280d9106-0367-4d2f-9f6a-2ca4214a410a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-280d9106-0367-4d2f-9f6a-2ca4214a410a admin admin] Request method failure captured: Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Accept: application/json Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Accept-Encoding: gzip, deflate Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Connection: keep-alive Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Content-Length: 0 Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Host: 10.222.0.98 Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Openstack-Api-Version: compute 2.90 Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Openstack-System-Scope: None Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: User-Agent: python-novaclient Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Auth-Token: gAAAAABjCOoin3THnxlfE8QcGd2nhadKtToQcansq4JdCSq0X5_cYSt-wS1YeN9gwQVZeyVM5xAVSqto61Ng2M23RkuR9dPWTKY_yHvmXlwf03TRG1G1ASn59hzd1HhLyLC1u6R6YlbsYLekfJHCdMNfT4F6sMF1ok8F_wzNmwaT3Zaeau9waXc Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Domain-Id: None Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Domain-Name: None Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Identity-Status: Confirmed Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Is-Admin-Project: True Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Project-Domain-Id: default Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Project-Domain-Name: Default Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Project-Id: 86d26d8b55fb4a2b877ae676d9b1d379 Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Project-Name: admin Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Role: member,reader,admin Aug 26 15:43:30.937031 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Roles: member,reader,admin Aug 26 15:43:30.942077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86d26d8b55fb4a2b877ae676d9b1d379"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86d26d8b55fb4a2b877ae676d9b1d379", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86d26d8b55fb4a2b877ae676d9b1d379"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86d26d8b55fb4a2b877ae676d9b1d379"}]}] Aug 26 15:43:30.942077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Tenant: admin Aug 26 15:43:30.942077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Tenant-Id: 86d26d8b55fb4a2b877ae676d9b1d379 Aug 26 15:43:30.942077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Tenant-Name: admin Aug 26 15:43:30.942077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-User: admin Aug 26 15:43:30.942077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-User-Domain-Id: default Aug 26 15:43:30.942077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-User-Domain-Name: Default Aug 26 15:43:30.942077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-User-Id: 3fea9e7c5b754acaa0233c15976ac3b3 Aug 26 15:43:30.942077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-User-Name: admin Aug 26 15:43:30.942077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: method: > Aug 26 15:43:30.942077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: exception: Flavor 42 could not be found. Aug 26 15:43:30.942077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: action_args: {'id': '42'} Aug 26 15:43:30.942077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:43:30.942077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:43:30.943086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Aug 26 15:43:30.944419 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-280d9106-0367-4d2f-9f6a-2ca4214a410a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:43:30.945674 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-280d9106-0367-4d2f-9f6a-2ca4214a410a admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015711 Aug 26 15:43:30.945674 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 22/42] 10.222.0.98 () {60 vars in 1190 bytes} [Fri Aug 26 15:43:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:31.932876 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-bd68347b-3643-4636-9c01-5041c66528dc admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:31.934388 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-bd68347b-3643-4636-9c01-5041c66528dc admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002439 Aug 26 15:43:31.934789 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 21/43] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Aug 26 15:43:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:43:32.467056 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-2122bb93-2c5b-46d4-91ad-8a7020e2d7a4 admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:32.473006 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.wsgi [None req-2122bb93-2c5b-46d4-91ad-8a7020e2d7a4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-2122bb93-2c5b-46d4-91ad-8a7020e2d7a4 admin admin] Request method failure captured: Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Accept: application/json Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Accept-Encoding: gzip, deflate Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Connection: keep-alive Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Content-Length: 0 Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Host: 10.222.0.98 Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Openstack-Api-Version: compute 2.90 Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Openstack-System-Scope: None Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: User-Agent: python-novaclient Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Auth-Token: gAAAAABjCOojk7cDPtdjKEumHrAxKY-sFTf3FefVJyizFOJj_QHQHV6kiOV55f2t3TIqi2z7h5GuDHNca1VIgh8jGJ-zR-_2sM9iqjnQHpcm3Bjdy4qy4m1LdOMZ8syt_G7ma5TcmCY0GpHr62oqMLY0fmS8oZZJsveefyOIb01h__jBwiTTYrQ Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Domain-Id: None Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Domain-Name: None Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Identity-Status: Confirmed Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Is-Admin-Project: True Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Project-Domain-Id: default Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Project-Domain-Name: Default Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Project-Id: 86d26d8b55fb4a2b877ae676d9b1d379 Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Project-Name: admin Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Role: member,reader,admin Aug 26 15:43:32.474629 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Roles: member,reader,admin Aug 26 15:43:32.476243 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86d26d8b55fb4a2b877ae676d9b1d379"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86d26d8b55fb4a2b877ae676d9b1d379", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86d26d8b55fb4a2b877ae676d9b1d379"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86d26d8b55fb4a2b877ae676d9b1d379"}]}] Aug 26 15:43:32.476243 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Tenant: admin Aug 26 15:43:32.476243 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Tenant-Id: 86d26d8b55fb4a2b877ae676d9b1d379 Aug 26 15:43:32.476243 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Tenant-Name: admin Aug 26 15:43:32.476243 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-User: admin Aug 26 15:43:32.476243 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-User-Domain-Id: default Aug 26 15:43:32.476243 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-User-Domain-Name: Default Aug 26 15:43:32.476243 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-User-Id: 3fea9e7c5b754acaa0233c15976ac3b3 Aug 26 15:43:32.476243 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-User-Name: admin Aug 26 15:43:32.476243 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: method: > Aug 26 15:43:32.476243 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: exception: Flavor 84 could not be found. Aug 26 15:43:32.476243 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: action_args: {'id': '84'} Aug 26 15:43:32.476243 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:43:32.476243 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:43:32.477360 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Aug 26 15:43:32.479501 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-2122bb93-2c5b-46d4-91ad-8a7020e2d7a4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:43:32.480784 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-2122bb93-2c5b-46d4-91ad-8a7020e2d7a4 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.395149 Aug 26 15:43:32.480784 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 23/44] 10.222.0.98 () {60 vars in 1190 bytes} [Fri Aug 26 15:43:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:32.486769 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-45e00664-1116-4b2e-ba04-c38232a98833 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:32.502080 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-45e00664-1116-4b2e-ba04-c38232a98833 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019249 Aug 26 15:43:32.502596 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 22/45] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Aug 26 15:43:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:43:32.512086 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-9b03b48e-7b32-45d7-a107-956927029cb2 admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:32.527897 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-9b03b48e-7b32-45d7-a107-956927029cb2 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019319 Aug 26 15:43:32.528449 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 24/46] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Aug 26 15:43:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:43:32.538555 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-ea40ce72-0f8b-486a-8ae9-ce196da60ea7 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:32.544622 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.wsgi [None req-ea40ce72-0f8b-486a-8ae9-ce196da60ea7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-ea40ce72-0f8b-486a-8ae9-ce196da60ea7 admin admin] Request method failure captured: Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Accept: application/json Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Accept-Encoding: gzip, deflate Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Connection: keep-alive Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Content-Length: 0 Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Host: 10.222.0.98 Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Openstack-Api-Version: compute 2.90 Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Openstack-System-Scope: None Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: User-Agent: python-novaclient Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Auth-Token: gAAAAABjCOojk7cDPtdjKEumHrAxKY-sFTf3FefVJyizFOJj_QHQHV6kiOV55f2t3TIqi2z7h5GuDHNca1VIgh8jGJ-zR-_2sM9iqjnQHpcm3Bjdy4qy4m1LdOMZ8syt_G7ma5TcmCY0GpHr62oqMLY0fmS8oZZJsveefyOIb01h__jBwiTTYrQ Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Domain-Id: None Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Domain-Name: None Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Identity-Status: Confirmed Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Is-Admin-Project: True Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Project-Domain-Id: default Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Project-Domain-Name: Default Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Project-Id: 86d26d8b55fb4a2b877ae676d9b1d379 Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Project-Name: admin Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Role: member,reader,admin Aug 26 15:43:32.546121 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Roles: member,reader,admin Aug 26 15:43:32.547641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86d26d8b55fb4a2b877ae676d9b1d379"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86d26d8b55fb4a2b877ae676d9b1d379", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86d26d8b55fb4a2b877ae676d9b1d379"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86d26d8b55fb4a2b877ae676d9b1d379"}]}] Aug 26 15:43:32.547641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Tenant: admin Aug 26 15:43:32.547641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Tenant-Id: 86d26d8b55fb4a2b877ae676d9b1d379 Aug 26 15:43:32.547641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Tenant-Name: admin Aug 26 15:43:32.547641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-User: admin Aug 26 15:43:32.547641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-User-Domain-Id: default Aug 26 15:43:32.547641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-User-Domain-Name: Default Aug 26 15:43:32.547641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-User-Id: 3fea9e7c5b754acaa0233c15976ac3b3 Aug 26 15:43:32.547641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-User-Name: admin Aug 26 15:43:32.547641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: method: > Aug 26 15:43:32.547641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: exception: Flavor 84 could not be found. Aug 26 15:43:32.547641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: action_args: {'id': '84'} Aug 26 15:43:32.547641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:43:32.547641 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:43:32.548749 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Aug 26 15:43:32.550241 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-ea40ce72-0f8b-486a-8ae9-ce196da60ea7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:43:32.551474 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-ea40ce72-0f8b-486a-8ae9-ce196da60ea7 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012908 Aug 26 15:43:32.551474 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 23/47] 10.222.0.98 () {60 vars in 1190 bytes} [Fri Aug 26 15:43:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:33.522202 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-9b03b48e-7b32-45d7-a107-956927029cb2 admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:33.523293 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-9b03b48e-7b32-45d7-a107-956927029cb2 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 26 15:43:33.523693 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 25/48] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Aug 26 15:43:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:43:34.069596 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-ef1ace24-2efc-4ee9-898a-72c85280c31e admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:34.075848 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.wsgi [None req-ef1ace24-2efc-4ee9-898a-72c85280c31e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-ef1ace24-2efc-4ee9-898a-72c85280c31e admin admin] Request method failure captured: Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Accept: application/json Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Accept-Encoding: gzip, deflate Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Connection: keep-alive Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Content-Length: 0 Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Host: 10.222.0.98 Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Openstack-Api-Version: compute 2.90 Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Openstack-System-Scope: None Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: User-Agent: python-novaclient Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Auth-Token: gAAAAABjCOoljQuzMyfhrzCcnE6B_RIcZ_bnunKGuGv18j4IiK1rogpWa6yQZZYQcNcFJOEFtw8BlIWTzu7vjgpb2zzB0JQ0Dt_WpJrS-PQRrQpttetMLiA1f0LDOVl6bYVog6Y-JkpuJb5_wBlCiDDHvxRCw_ltDVawv7jlbtwWSOdDm6MTwss Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Domain-Id: None Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Domain-Name: None Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Identity-Status: Confirmed Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Is-Admin-Project: True Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Project-Domain-Id: default Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Project-Domain-Name: Default Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Project-Id: 86d26d8b55fb4a2b877ae676d9b1d379 Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Project-Name: admin Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Role: member,reader,admin Aug 26 15:43:34.077366 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Roles: member,reader,admin Aug 26 15:43:34.078949 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86d26d8b55fb4a2b877ae676d9b1d379"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86d26d8b55fb4a2b877ae676d9b1d379", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86d26d8b55fb4a2b877ae676d9b1d379"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86d26d8b55fb4a2b877ae676d9b1d379"}]}] Aug 26 15:43:34.078949 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Tenant: admin Aug 26 15:43:34.078949 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Tenant-Id: 86d26d8b55fb4a2b877ae676d9b1d379 Aug 26 15:43:34.078949 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-Tenant-Name: admin Aug 26 15:43:34.078949 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-User: admin Aug 26 15:43:34.078949 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-User-Domain-Id: default Aug 26 15:43:34.078949 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-User-Domain-Name: Default Aug 26 15:43:34.078949 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-User-Id: 3fea9e7c5b754acaa0233c15976ac3b3 Aug 26 15:43:34.078949 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: X-User-Name: admin Aug 26 15:43:34.078949 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: method: > Aug 26 15:43:34.078949 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: exception: Flavor 451 could not be found. Aug 26 15:43:34.078949 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: action_args: {'id': '451'} Aug 26 15:43:34.078949 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:43:34.078949 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:43:34.079962 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: ERROR nova.api.openstack.wsgi Aug 26 15:43:34.081283 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-ef1ace24-2efc-4ee9-898a-72c85280c31e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:43:34.082525 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-ef1ace24-2efc-4ee9-898a-72c85280c31e admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.416463 Aug 26 15:43:34.082525 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 24/49] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Aug 26 15:43:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:34.088319 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-58c63c38-c07d-4d53-8a06-c7870b239d59 admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:34.103413 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-58c63c38-c07d-4d53-8a06-c7870b239d59 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018652 Aug 26 15:43:34.104014 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 26/50] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Aug 26 15:43:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:43:34.113592 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-e09b2fd5-81a6-42e9-a97f-f10c40bc3514 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:34.129021 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-e09b2fd5-81a6-42e9-a97f-f10c40bc3514 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018970 Aug 26 15:43:34.129738 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 25/51] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Aug 26 15:43:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:43:34.139544 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-d82405ab-3960-4d18-8b9e-ca08b5e46443 admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:34.144978 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.wsgi [None req-d82405ab-3960-4d18-8b9e-ca08b5e46443 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-d82405ab-3960-4d18-8b9e-ca08b5e46443 admin admin] Request method failure captured: Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Accept: application/json Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Accept-Encoding: gzip, deflate Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Connection: keep-alive Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Content-Length: 0 Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Host: 10.222.0.98 Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Openstack-Api-Version: compute 2.90 Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Openstack-System-Scope: None Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: User-Agent: python-novaclient Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Auth-Token: gAAAAABjCOoljQuzMyfhrzCcnE6B_RIcZ_bnunKGuGv18j4IiK1rogpWa6yQZZYQcNcFJOEFtw8BlIWTzu7vjgpb2zzB0JQ0Dt_WpJrS-PQRrQpttetMLiA1f0LDOVl6bYVog6Y-JkpuJb5_wBlCiDDHvxRCw_ltDVawv7jlbtwWSOdDm6MTwss Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Domain-Id: None Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Domain-Name: None Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Identity-Status: Confirmed Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Is-Admin-Project: True Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Project-Domain-Id: default Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Project-Domain-Name: Default Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Project-Id: 86d26d8b55fb4a2b877ae676d9b1d379 Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Project-Name: admin Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Role: member,reader,admin Aug 26 15:43:34.146485 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Roles: member,reader,admin Aug 26 15:43:34.148088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/86d26d8b55fb4a2b877ae676d9b1d379"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_86d26d8b55fb4a2b877ae676d9b1d379", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86d26d8b55fb4a2b877ae676d9b1d379"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/86d26d8b55fb4a2b877ae676d9b1d379"}]}] Aug 26 15:43:34.148088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Tenant: admin Aug 26 15:43:34.148088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Tenant-Id: 86d26d8b55fb4a2b877ae676d9b1d379 Aug 26 15:43:34.148088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-Tenant-Name: admin Aug 26 15:43:34.148088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-User: admin Aug 26 15:43:34.148088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-User-Domain-Id: default Aug 26 15:43:34.148088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-User-Domain-Name: Default Aug 26 15:43:34.148088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-User-Id: 3fea9e7c5b754acaa0233c15976ac3b3 Aug 26 15:43:34.148088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: X-User-Name: admin Aug 26 15:43:34.148088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: method: > Aug 26 15:43:34.148088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: exception: Flavor 451 could not be found. Aug 26 15:43:34.148088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: action_args: {'id': '451'} Aug 26 15:43:34.148088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:43:34.148088 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:43:34.149084 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: ERROR nova.api.openstack.wsgi Aug 26 15:43:34.150528 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-d82405ab-3960-4d18-8b9e-ca08b5e46443 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:43:34.151792 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-d82405ab-3960-4d18-8b9e-ca08b5e46443 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012524 Aug 26 15:43:34.151792 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 27/52] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Aug 26 15:43:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:35.130427 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-e09b2fd5-81a6-42e9-a97f-f10c40bc3514 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:35.131446 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-e09b2fd5-81a6-42e9-a97f-f10c40bc3514 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 26 15:43:35.131841 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 26/53] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Aug 26 15:43:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:43:35.649861 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-e1d93cdd-6063-4e78-933e-1592b5e9ddf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:43:35.732532 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-e1d93cdd-6063-4e78-933e-1592b5e9ddf9 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.463380 Aug 26 15:43:35.733529 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 28/54] 10.222.0.98 () {64 vars in 1235 bytes} [Fri Aug 26 15:43:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:43:36.718396 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-e09b2fd5-81a6-42e9-a97f-f10c40bc3514 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:36.719594 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-e09b2fd5-81a6-42e9-a97f-f10c40bc3514 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 Aug 26 15:43:36.720028 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 27/55] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Aug 26 15:43:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:43:37.303963 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-bcb83da5-4f24-4bbe-9633-b54f2669f8e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:43:37.419719 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-bcb83da5-4f24-4bbe-9633-b54f2669f8e2 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.536180 Aug 26 15:43:37.420299 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 29/56] 10.222.0.98 () {64 vars in 1235 bytes} [Fri Aug 26 15:43:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:43:38.400180 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-e09b2fd5-81a6-42e9-a97f-f10c40bc3514 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:38.401709 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-e09b2fd5-81a6-42e9-a97f-f10c40bc3514 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Aug 26 15:43:38.402130 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 28/57] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Aug 26 15:43:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:43:38.932329 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-3175cb58-c163-4f75-8997-10d5ef1e81ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:43:39.013929 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-3175cb58-c163-4f75-8997-10d5ef1e81ea admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.470786 Aug 26 15:43:39.014401 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 30/58] 10.222.0.98 () {64 vars in 1235 bytes} [Fri Aug 26 15:43:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:43:40.029874 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-e09b2fd5-81a6-42e9-a97f-f10c40bc3514 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:40.030880 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-e09b2fd5-81a6-42e9-a97f-f10c40bc3514 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 26 15:43:40.031272 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 29/59] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Aug 26 15:43:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:43:40.560643 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-30dc2520-adda-490c-a917-b149eec0de3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:43:40.642439 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-30dc2520-adda-490c-a917-b149eec0de3e admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.471832 Aug 26 15:43:40.642996 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 31/60] 10.222.0.98 () {64 vars in 1235 bytes} [Fri Aug 26 15:43:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:43:41.609545 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-e09b2fd5-81a6-42e9-a97f-f10c40bc3514 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:41.610622 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-e09b2fd5-81a6-42e9-a97f-f10c40bc3514 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 26 15:43:41.611025 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 30/61] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Aug 26 15:43:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:43:42.133362 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-95645aa6-7c20-4b65-9d65-6d4be8b51714 admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:43:42.154382 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-95645aa6-7c20-4b65-9d65-6d4be8b51714 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406198 Aug 26 15:43:42.154954 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 32/62] 10.222.0.98 () {60 vars in 1202 bytes} [Fri Aug 26 15:43:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:44:35.745082 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-e09b2fd5-81a6-42e9-a97f-f10c40bc3514 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:44:35.746170 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-e09b2fd5-81a6-42e9-a97f-f10c40bc3514 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 26 15:44:35.746567 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 31/63] 10.222.0.98 () {54 vars in 931 bytes} [Fri Aug 26 15:44:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:44:35.756970 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG dbcounter [-] [112680] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:44:36.146065 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-89fc467d-757e-44c1-a4b0-b9bb2037cfc6 admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:44:36.175442 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-89fc467d-757e-44c1-a4b0-b9bb2037cfc6 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.422845 Aug 26 15:44:36.176005 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 33/64] 10.222.0.98 () {60 vars in 1292 bytes} [Fri Aug 26 15:44:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:44:36.196791 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG dbcounter [-] [112679] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:44:36.200646 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-299523c7-2b41-46ee-b904-62cef0832b70 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:44:36.208352 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-299523c7-2b41-46ee-b904-62cef0832b70 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013140 Aug 26 15:44:36.210551 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 32/65] 10.222.0.98 () {60 vars in 1283 bytes} [Fri Aug 26 15:44:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:44:36.221077 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-824b3e55-ddb7-4e21-8b7d-7476473c0d53 admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:44:36.229403 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-824b3e55-ddb7-4e21-8b7d-7476473c0d53 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012049 Aug 26 15:44:36.229938 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 34/66] 10.222.0.98 () {60 vars in 1286 bytes} [Fri Aug 26 15:44:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:44:36.241798 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-89f7c26c-ae6c-494c-b82c-2e6a6fdd38a0 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:44:36.249986 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-89f7c26c-ae6c-494c-b82c-2e6a6fdd38a0 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011799 Aug 26 15:44:36.250526 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 33/67] 10.222.0.98 () {60 vars in 1286 bytes} [Fri Aug 26 15:44:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:44:36.262427 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-fa26c4f8-0741-48c4-8736-b5fa52ff05be admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:44:36.270109 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-fa26c4f8-0741-48c4-8736-b5fa52ff05be admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011449 Aug 26 15:44:36.270623 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 35/68] 10.222.0.98 () {60 vars in 1283 bytes} [Fri Aug 26 15:44:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:48:05.301814 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-89f7c26c-ae6c-494c-b82c-2e6a6fdd38a0 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:48:05.303119 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-89f7c26c-ae6c-494c-b82c-2e6a6fdd38a0 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001747 Aug 26 15:48:05.303541 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 34/69] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Aug 26 15:48:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:48:05.447651 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG dbcounter [-] [112680] Writing DB stats nova_api:SELECT=6 {{(pid=112680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:05.609835 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-d0e3af07-dd63-4063-872d-9b3e960e4e93 admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:48:05.613439 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-d0e3af07-dd63-4063-872d-9b3e960e4e93 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:48:05.613917 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-d0e3af07-dd63-4063-872d-9b3e960e4e93 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:48:05.614377 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-d0e3af07-dd63-4063-872d-9b3e960e4e93 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:48:05.615095 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-d0e3af07-dd63-4063-872d-9b3e960e4e93 admin admin] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:48:05.615543 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-d0e3af07-dd63-4063-872d-9b3e960e4e93 admin admin] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:48:05.615990 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-d0e3af07-dd63-4063-872d-9b3e960e4e93 admin admin] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:48:05.649888 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-d0e3af07-dd63-4063-872d-9b3e960e4e93 admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.203638 Aug 26 15:48:05.650453 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 36/70] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Aug 26 15:48:05 2022] GET /compute/v2.1/os-services => generated 794 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:48:06.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-89f7c26c-ae6c-494c-b82c-2e6a6fdd38a0 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:48:06.501487 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-89f7c26c-ae6c-494c-b82c-2e6a6fdd38a0 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 26 15:48:06.501885 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 35/71] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Aug 26 15:48:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:48:06.693985 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-ec0e798e-9b31-4244-8108-a5192b666d42 admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:48:06.697456 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-ec0e798e-9b31-4244-8108-a5192b666d42 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:48:06.697922 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-ec0e798e-9b31-4244-8108-a5192b666d42 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:48:06.698896 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-ec0e798e-9b31-4244-8108-a5192b666d42 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:48:06.699602 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-ec0e798e-9b31-4244-8108-a5192b666d42 admin admin] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:48:06.700075 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-ec0e798e-9b31-4244-8108-a5192b666d42 admin admin] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:48:06.700489 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-ec0e798e-9b31-4244-8108-a5192b666d42 admin admin] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:48:06.720157 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-ec0e798e-9b31-4244-8108-a5192b666d42 admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077775 Aug 26 15:48:06.720704 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 37/72] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Aug 26 15:48:06 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:48:18.046234 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-89f7c26c-ae6c-494c-b82c-2e6a6fdd38a0 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:48:18.047249 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-89f7c26c-ae6c-494c-b82c-2e6a6fdd38a0 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 26 15:48:18.047918 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 36/73] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Aug 26 15:48:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:48:18.194583 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG dbcounter [-] [112680] Writing DB stats nova_cell0:SELECT=4 {{(pid=112680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:18.195320 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG dbcounter [-] [112680] Writing DB stats nova_cell1:SELECT=4 {{(pid=112680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:18.195982 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG dbcounter [-] [112680] Writing DB stats nova_api:SELECT=8 {{(pid=112680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:18.251129 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-9024c945-ed1f-4509-98b4-4568baf129f5 admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:48:18.254965 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-9024c945-ed1f-4509-98b4-4568baf129f5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:48:18.255441 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-9024c945-ed1f-4509-98b4-4568baf129f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:48:18.255884 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-9024c945-ed1f-4509-98b4-4568baf129f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:48:18.256619 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-9024c945-ed1f-4509-98b4-4568baf129f5 admin admin] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:48:18.257069 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-9024c945-ed1f-4509-98b4-4568baf129f5 admin admin] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:48:18.257492 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-9024c945-ed1f-4509-98b4-4568baf129f5 admin admin] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:48:18.285827 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-9024c945-ed1f-4509-98b4-4568baf129f5 admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.096517 Aug 26 15:48:18.286448 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 38/74] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Aug 26 15:48:18 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:48:19.118308 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: DEBUG nova.api.openstack.wsgi [None req-89f7c26c-ae6c-494c-b82c-2e6a6fdd38a0 admin admin] Calling method '>' {{(pid=112679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:48:19.119384 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: INFO nova.api.openstack.requestlog [None req-89f7c26c-ae6c-494c-b82c-2e6a6fdd38a0 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 26 15:48:19.119843 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: [pid: 112679|app: 0|req: 37/75] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Aug 26 15:48:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:48:19.318200 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG nova.api.openstack.wsgi [None req-43cd2833-6eaf-4c3d-84da-6867b2aa72ee admin admin] Calling method '>' {{(pid=112680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:48:19.321690 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-43cd2833-6eaf-4c3d-84da-6867b2aa72ee admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:48:19.322192 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-43cd2833-6eaf-4c3d-84da-6867b2aa72ee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:48:19.322623 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-43cd2833-6eaf-4c3d-84da-6867b2aa72ee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:48:19.323372 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-43cd2833-6eaf-4c3d-84da-6867b2aa72ee admin admin] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:48:19.323819 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-43cd2833-6eaf-4c3d-84da-6867b2aa72ee admin admin] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:48:19.324264 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: DEBUG oslo_concurrency.lockutils [None req-43cd2833-6eaf-4c3d-84da-6867b2aa72ee admin admin] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:48:19.345937 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: INFO nova.api.openstack.requestlog [None req-43cd2833-6eaf-4c3d-84da-6867b2aa72ee admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.080503 Aug 26 15:48:19.346433 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: [pid: 112680|app: 0|req: 39/76] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Aug 26 15:48:19 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:49:17.046530 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: Fri Aug 26 15:49:17 2022 - graceful shutdown triggered... Aug 26 15:49:17.046307 dv-cinder-831247-24-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 26 15:49:17.047462 dv-cinder-831247-24-iscsi devstack@n-api.service[112680]: Gracefully killing worker 2 (pid: 112680)... Aug 26 15:49:17.047825 dv-cinder-831247-24-iscsi devstack@n-api.service[112679]: Gracefully killing worker 1 (pid: 112679)... Aug 26 15:49:18.047336 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: worker 1 buried after 1 seconds Aug 26 15:49:18.047945 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: worker 2 buried after 1 seconds Aug 26 15:49:18.047945 dv-cinder-831247-24-iscsi devstack@n-api.service[112678]: goodbye to uWSGI. Aug 26 15:49:18.048965 dv-cinder-831247-24-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 26 15:49:18.049568 dv-cinder-831247-24-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 26 15:49:18.052410 dv-cinder-831247-24-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 15:49:18.061959 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 15:49:18.064658 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 15:49:18 2022] *** Aug 26 15:49:18.064814 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 15:49:18.064961 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 15:49:18.065075 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: nodename: dv-cinder-831247-24-iscsi Aug 26 15:49:18.065186 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: machine: x86_64 Aug 26 15:49:18.065287 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: clock source: unix Aug 26 15:49:18.065400 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: pcre jit disabled Aug 26 15:49:18.065509 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: detected number of CPU cores: 4 Aug 26 15:49:18.065624 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: current working directory: / Aug 26 15:49:18.065733 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: detected binary path: /usr/bin/uwsgi-core Aug 26 15:49:18.065847 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: your processes number limit is 47680 Aug 26 15:49:18.065967 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: your memory page size is 4096 bytes Aug 26 15:49:18.066078 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: detected max file descriptor number: 2048 Aug 26 15:49:18.066187 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: lock engine: pthread robust mutexes Aug 26 15:49:18.066465 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: thunder lock: enabled Aug 26 15:49:18.066759 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 15:49:18.066955 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 15:49:18.107906 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: Python main interpreter initialized at 0x559eb4bf39c0 Aug 26 15:49:18.107906 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: python threads support enabled Aug 26 15:49:18.107906 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: your server socket listen backlog is limited to 100 connections Aug 26 15:49:18.107906 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: your mercy for graceful operations on workers is 90 seconds Aug 26 15:49:18.107906 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 15:49:18.107906 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: *** Operational MODE: preforking *** Aug 26 15:49:18.108424 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: *** uWSGI is running in multiple interpreter mode *** Aug 26 15:49:18.108424 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: spawned uWSGI master process (pid: 127679) Aug 26 15:49:18.108307 dv-cinder-831247-24-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 15:49:18.110908 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: spawned uWSGI worker 1 (pid: 127697, cores: 1) Aug 26 15:49:18.113690 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: spawned uWSGI worker 2 (pid: 127698, cores: 1) Aug 26 15:49:18.113690 dv-cinder-831247-24-iscsi devstack@n-api.service[127679]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 15:49:18.783835 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 15:49:18.784502 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 15:49:19.948951 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:49:19.948951 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: from cryptography.utils import int_from_bytes Aug 26 15:49:19.949610 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:49:19.949610 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: from cryptography.utils import int_from_bytes Aug 26 15:49:19.991091 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:49:19.991091 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: from cryptography.utils import int_from_bytes Aug 26 15:49:19.991698 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:49:19.991698 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: from cryptography.utils import int_from_bytes Aug 26 15:49:22.382391 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 15:49:22.383014 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 15:49:22.383255 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 15:49:22.383589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 15:49:22.383851 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 15:49:22.384283 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.384621 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.384956 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.385281 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.385789 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.386111 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.386447 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.386782 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.387118 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.387389 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.387716 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.388142 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-24-iscsi {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.388479 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.388796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.389116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.389448 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.389787 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.390087 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.390405 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.390922 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.392545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.392545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.392545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.392545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.392932 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.393036 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.393279 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.393602 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.393927 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.394249 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.394652 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-24-iscsi {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.394976 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.395297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.395632 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.396088 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.396414 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.396734 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.397063 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.397393 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.397713 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.398062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.398390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.398738 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.399046 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.399354 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.399694 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.400001 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.400334 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.400646 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.400957 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.401231 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.401544 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.401858 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.402189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.402523 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.402783 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.403038 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.403364 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.404125 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.404452 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.404771 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.405083 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.405401 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.405717 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.406033 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.406347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.406660 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.406990 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.407312 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.407645 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.407990 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.408326 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.408748 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.409008 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.409323 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.409676 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.410005 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.410327 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.410655 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.410983 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.411301 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.411618 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.411962 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.412295 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.412629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.412942 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.413201 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.413513 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.413832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.414159 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.414474 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.414860 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.415099 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.415406 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.415722 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.416068 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.416383 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.416698 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.417012 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.417325 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.417642 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.417957 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.418269 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.418608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.418935 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.419796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.420141 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.420461 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.420775 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.421102 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.421416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.421730 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.422068 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.422382 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.422690 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.423014 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.423327 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.423685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.423992 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.424302 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.424617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.424940 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.425252 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.425564 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.425872 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.426182 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.426491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.426799 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.427107 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.427414 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.427716 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.428070 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.428401 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.428719 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.429032 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.429345 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.429669 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.430017 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.430661 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.431105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.431425 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.431779 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.432155 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.432483 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.432801 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.433120 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.433450 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.433765 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.434081 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.434398 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.434725 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.435614 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.435966 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.436292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.436614 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.436938 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.437255 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.437578 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.437913 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.438242 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.438558 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.438906 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.439258 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.439577 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.439952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.440280 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.440603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.440924 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.441242 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.441570 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.441910 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.442229 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.442552 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.442871 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.443199 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.443520 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.443836 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.444177 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.444497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.444815 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.445155 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.445478 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.446268 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.446268 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.446473 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.446734 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.447050 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.447368 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.447683 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.448034 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.448203 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 15:49:22.448677 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 15:49:22.448842 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.448842 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.449131 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 15:49:22.449286 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.449441 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 15:49:22.449612 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.449757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 15:49:22.449917 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.450075 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.450228 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.450412 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.450508 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.450739 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.450891 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.451044 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.451200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.451200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.451474 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.451615 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.451780 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.451972 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.452128 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.452291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.452446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.452613 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.452767 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.452934 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.453075 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.453215 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.453354 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.453502 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.453660 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-24-iscsi {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.453819 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.453975 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.454127 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.454267 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.454426 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.454569 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.454716 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.454872 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.456170 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.456344 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.456509 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.456659 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.456798 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.456961 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.457112 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.457251 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.457421 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.457563 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.457753 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.457898 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.458048 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.458201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.458348 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.458498 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.458648 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.458789 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.458930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.459080 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.459231 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.459382 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.459538 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.459678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.459836 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.460527 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.460731 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.460907 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.461047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.461214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-24-iscsi {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.461372 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.461512 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.461650 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.461802 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.461960 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.462121 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.462273 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.462273 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.462558 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.462832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.462975 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.463154 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.463748 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.463916 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.464079 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.464237 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.464378 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.464605 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.464755 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.464894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.465035 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.465192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.465881 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.466562 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.466722 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.466876 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.467016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.467156 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.467309 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.467459 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.467600 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.467748 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.467923 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.468075 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.468233 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.468233 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.468499 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.468649 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.468800 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.468950 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.469089 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.469288 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.469376 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.469459 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.469548 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.469642 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.469727 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.469838 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.469915 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.469995 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.470068 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.470139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.470225 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.470299 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.470371 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.470443 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.470522 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.470594 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.470678 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.471231 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.471322 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.471397 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.471481 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.471570 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.471644 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.471725 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.471725 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.471890 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.471985 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.472069 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.472151 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.472224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.472296 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.472366 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.472449 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.472539 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.472613 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.472685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.472756 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.472834 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.472906 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.472987 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.473068 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.473148 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.473221 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.473293 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.473378 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.473452 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.473525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.473596 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.473713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.473799 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.474019 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.474102 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.474338 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.474436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.474657 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.474741 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.474963 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.475047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.475269 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.475365 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.476832 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.477034 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.477202 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.477351 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.477505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.477653 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.477825 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.477988 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.478146 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.478301 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.478465 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.478611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.478804 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.478966 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.479114 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.479259 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.479413 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.479590 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.479749 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.479934 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.480094 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.480259 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.480425 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.480588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.480737 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.480943 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.481102 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.481248 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.481401 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.481547 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.481760 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.482463 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.482612 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.482765 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.482920 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.483073 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.483244 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.483397 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.483543 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.483707 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.483854 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.484026 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.484190 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.484382 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.484534 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.484690 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.484843 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.484990 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.485156 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.485309 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.485462 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.485462 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.486110 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.486269 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.486423 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.486576 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.486722 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.487106 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.487259 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.487412 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.487566 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.487730 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.487898 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.488068 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.488224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.488370 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.488515 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.488668 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.488823 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.488978 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.489124 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.489297 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.489921 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.490081 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.490263 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.490429 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.490585 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.490839 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.491051 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.491204 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.491438 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.491588 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.491733 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.491980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.492135 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.492292 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.492448 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.492607 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.492761 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.492915 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.492915 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.493206 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.493353 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.493498 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.493641 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.493794 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.493940 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.494100 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.494246 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.494398 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.494556 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.494716 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.494862 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.495020 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.495166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.495310 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.495455 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:49:22.495600 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.495753 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.496638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.496811 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.497760 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.497948 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.498098 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.498255 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.498408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.498555 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.498711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.498857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.499010 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.499177 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.499177 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.499471 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.499659 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.499813 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.500018 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.500184 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.500346 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.500497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.500650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.500796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.500956 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.501154 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.501307 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.501463 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.501619 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.501792 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.502080 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.502255 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.502404 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.502549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.502703 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.502850 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.502995 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.503155 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.503309 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.503456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.503618 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.503772 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.503947 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.504110 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.504264 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.504429 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.504576 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.504721 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.504882 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.505756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.505930 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.506380 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.506547 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.506711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.507133 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.507533 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.507700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.507856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.508083 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.508247 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.508402 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.508549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.508694 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.508838 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.508991 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.509148 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.509294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.509458 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.509612 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.509768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.509928 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.510082 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.510236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.510393 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.510546 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.510693 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.510851 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.510999 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.511195 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.511355 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.511512 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.511665 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.511826 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.511995 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.512141 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.512298 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.512452 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.512597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.512754 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.512926 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.513086 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.513239 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.513397 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.513558 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.513712 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.513911 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.514057 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.514211 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.514359 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.514514 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.514660 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.514804 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.514961 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.515107 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.515259 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.515431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.515593 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.515745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.515911 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.516066 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.516571 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.516739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.516887 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.517039 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.517185 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.517330 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.517732 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.517888 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.518046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.518200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.518354 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.518506 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.518894 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.518997 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.519085 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.519180 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.519274 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.519367 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.519469 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.519556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.519642 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.519726 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.519810 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.519912 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.520020 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.520269 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.520373 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.520456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.520531 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.520614 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.520688 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.520768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.520855 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.520936 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.521017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.521177 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.521325 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.521426 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.521521 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.521614 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.521700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.521803 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.521890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.521975 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.522060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.522133 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.522205 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.522285 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.522379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.522464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.522557 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.522644 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.522746 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.522840 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.522926 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.523018 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.523105 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.523197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.523292 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.523378 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.523463 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.523546 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.523638 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.523724 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.523818 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.523972 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.523972 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.523972 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.523972 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.524289 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.524384 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.524471 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.524570 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.524658 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.524750 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.524846 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.524939 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.525025 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.525159 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.525255 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.525434 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.525536 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.525622 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.525714 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.525799 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.525893 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.525987 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.526082 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.526168 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.526263 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.526344 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.526449 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.526752 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.526858 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.526946 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.527040 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.527135 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.527230 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.527326 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.527412 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.527505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.527631 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.527882 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.527980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.528087 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.528184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.528272 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.528364 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.528449 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.529063 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.529163 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.529264 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.529350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.529435 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.529528 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.529614 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.529712 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.529799 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.529882 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.529975 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.530061 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.530160 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.530246 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.530339 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.530433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.530520 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.530603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.530702 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.530793 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.530886 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.530972 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.531056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.531139 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.531233 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.531369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.531466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.531566 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.531653 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.531738 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.531836 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.531990 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.532079 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.532165 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.532250 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.532350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.532439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.532534 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.532707 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.532811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.533032 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.533136 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.533353 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.533444 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.533665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.533766 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.533981 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.534089 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.534288 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.534389 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.534596 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.534731 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.534908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.535043 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.535218 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.535333 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.535522 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.535631 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.535832 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.542387 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.542507 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.542609 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.542609 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.542776 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.542876 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.542963 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.543047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.543131 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.543222 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.543315 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.543432 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.543534 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.543631 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.543707 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.543791 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.543893 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.544000 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.544087 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.544223 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.544321 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.544911 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.545000 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.545165 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.545253 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.545253 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.545414 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.545508 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.545602 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.545688 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.545769 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.545850 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.545946 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.546024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.546110 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.546185 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.546256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.546327 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.546396 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.546476 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.546562 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.546562 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.546722 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.546802 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.546894 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.546975 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.547047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.547117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.547196 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.547274 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.547346 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.547429 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.547510 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.547594 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.547678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.547757 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.547879 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.547988 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.548072 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.548144 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.548217 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.548286 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.548369 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.548467 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.548541 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.548611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.548702 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.548794 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.548887 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.548980 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.549065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.549148 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.549240 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.549325 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.549417 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.549666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.549780 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.549867 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.549952 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.550036 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.550130 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.550216 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.550301 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.550383 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.550475 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.550569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.550668 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.550760 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.550847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.550931 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.551016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.551113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.551207 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.551300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.551385 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.551636 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.551826 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.552050 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.552151 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.552301 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.552423 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.552614 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.552708 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.552931 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.555401 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.555401 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.556405 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.556508 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.556613 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.556716 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.556804 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.556878 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.556949 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.557027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.557110 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.557110 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.557256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.557329 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.557399 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.557470 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.557550 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.557632 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.557704 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.557774 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.557774 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.557902 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.557999 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.558073 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.558144 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.558221 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.558298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.558371 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.558451 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.558530 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.558616 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.558701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.558782 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.558964 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.559062 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.559269 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.559358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.559580 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.560021 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.560120 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.560196 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.560494 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.560747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.561064 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.561378 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.561537 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.561695 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.561888 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.562058 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.562175 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.562362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.562499 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.562691 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.562839 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.563038 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.563153 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.563375 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.563480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.563695 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.563789 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.564070 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.564242 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.565475 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.565659 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.565762 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.565859 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.565959 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.566064 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.566152 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.566237 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.566331 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.566418 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.566513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.566607 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.566701 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.566796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.566932 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.567030 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.567127 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.567221 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.567310 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.567394 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.567479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.567575 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.567719 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.567853 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.568092 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.568190 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.572639 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.572811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.572920 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.573016 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.573111 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.573206 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.573374 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.573463 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.573557 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.573643 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.573735 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.573820 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.573924 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.574011 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.574096 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.574180 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.574264 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.574347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.574445 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.574539 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.574625 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.574716 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.574820 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.574912 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.575011 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.575097 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.575189 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.575274 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.575407 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.575537 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.575634 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.575727 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.575813 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.575951 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.576055 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.576151 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.576238 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.576360 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.576452 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.576535 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.576610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.576697 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.576778 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.576850 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.576922 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.577005 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.577082 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.577187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.577264 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.577264 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.577264 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.577264 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.577540 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.577623 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.577696 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.577777 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.577849 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.577921 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.578006 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.578094 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.578184 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.578257 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.578336 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.578468 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.578593 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.578798 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.578906 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.579111 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.579225 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.579416 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.579545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.582267 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.582426 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.582527 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.582619 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.582711 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.582813 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.582813 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.582985 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.583072 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.583166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.583265 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.583358 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.583450 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.583542 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.583636 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.583722 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.583815 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.583918 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.584004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.584089 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.584187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.584282 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.584367 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.584450 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.584541 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.584636 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.584724 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.584798 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.584868 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.584939 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.585008 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.585101 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.585187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.585278 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.585370 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.585463 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.585548 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.585646 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.585871 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.586014 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.586190 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.586311 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.586495 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.586603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.586800 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.586894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.587137 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.587237 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.587445 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.587545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.587794 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.587965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.588143 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.588249 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.588462 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.588556 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.588784 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.588885 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.589099 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.589341 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.589449 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.589663 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.589756 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.590006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.590098 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.590338 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.590447 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.590669 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.590770 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.591587 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.591693 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.591862 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.591979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.592145 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.592251 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.592505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.592600 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.592772 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.592898 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.593083 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.593192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.593412 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.593517 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.593721 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.593824 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.594046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.594148 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.594350 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.594453 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.594655 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.594756 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.594963 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.595057 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.595271 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.595380 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.595612 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.595915 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.596011 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.596276 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.596392 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.596599 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.596703 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.596933 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.597071 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.597284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.597386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.597589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.597688 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.597900 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.597988 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.598236 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.598328 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.598547 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.598632 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.598856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.598939 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.599174 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.599279 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.599482 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.599565 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.600369 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.600490 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.600490 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.600650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.600734 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.600809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.600809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.600939 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.601011 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.601097 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.601329 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.601789 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.601914 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.602096 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.602180 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.602298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.602376 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.602970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.603641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.603641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.603796 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.603904 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.603998 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.604081 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.604163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.604245 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.604320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.604391 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.604462 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.604540 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.604644 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.604742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.604951 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.605052 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.605262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.605366 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.605566 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.605686 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.605873 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.605970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.606173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.606263 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.606486 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.607244 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.607367 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.607443 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.607670 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.607782 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.608012 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.608122 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.608321 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.608424 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.608644 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.608756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.608950 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.609054 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.609271 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.609431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.609570 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.609719 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.609889 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.609986 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.610244 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.610339 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.610577 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.610680 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.610985 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.611165 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.611282 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.611508 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.611610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.611841 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.611984 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.612214 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.612321 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.612536 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.612629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.612853 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.612978 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.613230 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.613346 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.613474 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.613577 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.613799 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.613902 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.614112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.614207 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.614426 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.614530 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.614728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.614816 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.615084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.615187 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.615359 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.615469 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.615672 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.615774 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.616025 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.616135 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.616361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.616540 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.616679 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.616787 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.616993 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.617098 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.617311 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.617424 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.617627 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.617723 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.617942 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.618046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.618242 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.618343 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.618549 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.618651 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.618849 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.618959 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.619152 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.619269 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.619474 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.619569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.619776 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.619896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.620166 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.620269 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.620485 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.620616 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.620803 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.620909 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.621103 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.621203 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.621453 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.621564 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.621716 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.621900 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.622022 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.622111 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.622377 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.622486 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.622687 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.622790 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.623007 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.623114 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.623350 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.623455 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.623633 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.623752 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.623977 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.624088 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.624291 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.624401 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.624593 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.624695 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.624897 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.624990 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.625200 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.625314 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.625545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.625652 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.625848 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.625941 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.626168 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.626270 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.626503 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.626686 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.626832 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.626930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.627139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.627258 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.627473 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.627572 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.627792 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.627915 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.628134 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.628251 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.628448 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.628551 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.628770 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.628879 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.629071 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.629180 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.629373 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.629472 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.629676 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.630240 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.630240 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.630452 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.630549 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.630645 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.630742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.630836 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.630956 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.631045 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.631132 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.631217 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.631427 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.631561 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.631699 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.631799 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.632050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.632165 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.632350 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.632457 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.632666 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.632770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.632971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.633065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.633273 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.633392 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.633580 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.633689 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.633878 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.633972 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.634182 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.634291 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.634485 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.634580 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.634793 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.634898 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.635100 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.635225 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.635425 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.635527 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.635744 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.635853 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.636107 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.636226 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.636438 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.636541 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.636756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.636856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.637085 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.637213 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.637401 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.637502 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.637719 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.637817 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.638412 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.638519 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.638616 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.639096 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.639279 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.639367 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.639487 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.639596 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.639701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.639835 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.640008 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.640175 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.640294 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.640494 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.640607 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.640806 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.640901 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.641122 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.641241 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.641434 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.641536 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.641746 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.641843 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.642060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.642169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.642368 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.642488 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.642680 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.642796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.643006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.643102 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.643331 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.643470 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.643658 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.643819 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.644003 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.644102 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.644324 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.644435 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.644638 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.644744 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.644953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.645050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.645265 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.645358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.645582 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.645687 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.645902 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.646023 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.646214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.646309 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.646528 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.646646 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.646841 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.646936 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.647153 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.647259 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.647464 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.647560 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.647773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.647916 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.648109 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.648238 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.648424 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.648520 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.648741 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.648855 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.649068 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.649194 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.649424 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.649536 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.649748 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.649866 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.650100 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.650207 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.650438 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.650544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.650762 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.650873 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.651077 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.651257 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.651387 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.651496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.651635 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 15:49:22.651731 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.652252 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.652586 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.652941 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.653269 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.654149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.654491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.654827 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.655187 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.655520 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.655934 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.656234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.656570 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.656894 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.657234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.657549 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.657853 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.658173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.658485 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.659150 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.659524 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.659975 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.660309 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.660636 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.660958 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.661266 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.661592 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.661898 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.662204 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.662521 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.662829 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.663143 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.663472 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.663808 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.664163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.664500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.664884 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.665242 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.665650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.665998 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.666354 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.666725 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.667080 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.667578 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.668165 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.668717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.669930 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.670512 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.671065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.671623 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.672213 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.672777 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.673331 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.673892 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.674510 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.675109 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.675662 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.676227 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.676808 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.677357 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.677869 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.678399 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.679014 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.679384 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.679715 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.680625 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.681124 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.681603 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.682107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.682627 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.683185 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.683515 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.683833 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.684197 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.684518 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.684863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.685184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.685500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.685817 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.686132 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.686450 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.686763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.687078 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.687389 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.687703 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.688040 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.688356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.688673 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.688988 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.689334 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.689654 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.689970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.690291 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.690607 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.690918 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.691227 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.691538 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.691846 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.692184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.692518 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.692832 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.693137 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.693568 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.693884 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.694210 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.694535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.694846 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.695170 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.695491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.695803 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.696150 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.696461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.696794 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.697135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.697465 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.697789 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.698201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.698395 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.698676 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.699094 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.699582 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.699918 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.700234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.700566 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.700880 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.701188 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.701496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.701800 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.702106 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.702416 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.702719 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.703022 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.703323 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.703627 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.703954 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.704260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.704582 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.704874 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.705176 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.705479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.705808 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.706080 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.706413 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.706780 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.707096 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.707419 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.707731 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.708081 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.708395 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.708717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.709041 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.709360 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.709669 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.710003 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.710321 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.710647 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.710933 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.711244 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.711555 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.711862 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.712210 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.712538 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.712848 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.713174 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.713493 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.713807 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.714189 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.714433 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.714763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.715073 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.715223 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO dbcounter [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] Registered counter for database nova_api Aug 26 15:49:22.715381 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.715707 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.716566 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.716940 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.717171 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.717484 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.717801 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.718110 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.718424 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.718751 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.719075 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.719384 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.719706 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.720060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.720410 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.720721 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.721066 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.721393 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.721707 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.722018 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.722322 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:49:22.722563 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 15:49:22.738359 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_db.sqlalchemy.engines [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:49:22.745393 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writer thread running {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:49:22.786096 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO dbcounter [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] Registered counter for database nova_api Aug 26 15:49:22.803640 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.context [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),739d7cf6-45f9-4f1f-972a-0b17316ed928(cell1) {{(pid=127697) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 15:49:22.807046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_db.sqlalchemy.engines [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:49:22.808040 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:49:22.808522 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:49:22.810162 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:49:22.810920 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:49:22.811377 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:49:22.813427 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:49:22.813736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writer thread running {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:49:22.815458 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO dbcounter [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] Registered counter for database nova_cell0 Aug 26 15:49:22.819826 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO dbcounter [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] Registered counter for database nova_cell1 Aug 26 15:49:22.828230 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_db.sqlalchemy.engines [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:49:22.829092 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_db.sqlalchemy.engines [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:49:22.836139 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writer thread running {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:49:22.837474 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writer thread running {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:49:22.869687 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.context [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),739d7cf6-45f9-4f1f-972a-0b17316ed928(cell1) {{(pid=127698) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 15:49:22.873745 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:49:22.874217 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:49:22.875801 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:49:22.876562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:49:22.877005 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:49:22.878999 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:49:22.881032 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO dbcounter [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] Registered counter for database nova_cell0 Aug 26 15:49:22.885110 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO dbcounter [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] Registered counter for database nova_cell1 Aug 26 15:49:22.892906 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_db.sqlalchemy.engines [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:49:22.894627 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_db.sqlalchemy.engines [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:49:22.900939 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writer thread running {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:49:22.902235 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writer thread running {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:49:22.986175 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO dbcounter [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] Registered counter for database nova_cell0 Aug 26 15:49:22.993006 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_db.sqlalchemy.engines [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:49:22.998887 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writer thread running {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:49:23.050756 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO dbcounter [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] Registered counter for database nova_cell0 Aug 26 15:49:23.058998 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_db.sqlalchemy.engines [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:49:23.063784 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writer thread running {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:49:23.352507 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: WARNING keystonemiddleware.auth_token [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:49:23.360552 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: WARNING keystonemiddleware.auth_token [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:49:23.391991 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: WARNING keystonemiddleware.auth_token [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:49:23.399568 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: WARNING keystonemiddleware.auth_token [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:49:23.708109 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: WARNING keystonemiddleware.auth_token [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:49:23.714148 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: WARNING keystonemiddleware.auth_token [None req-44df22b4-b0bb-4083-87d1-b4713f934fb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:49:23.719507 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559eb4bf39c0 pid: 127697 (default app) Aug 26 15:49:23.744242 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: WARNING keystonemiddleware.auth_token [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:49:23.750766 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: WARNING keystonemiddleware.auth_token [None req-ab306b46-90d5-4f8e-b5d2-fc96bb69bc32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:49:23.756048 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559eb4bf39c0 pid: 127698 (default app) Aug 26 15:50:02.116900 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=3 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:02.118019 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=3 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:02.118746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=3 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:02.119461 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=3 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:02.727187 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=3 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:02.728127 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=3 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:02.728860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=3 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:02.729589 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=3 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:03.989710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5857c4b2-2c47-47b7-a121-f07ca70b8496 tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] Action: 'create', calling method: .version_select at 0x7fbd1f271a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1908080200", "metadata": {"Type": "work"}}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:04.416927 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-086c80c0-3b08-4562-92ff-09c2972454ca tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Action: 'create', calling method: .version_select at 0x7fbd1f270a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-135549626"}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:06.615909 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5857c4b2-2c47-47b7-a121-f07ca70b8496 tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.506161 Aug 26 15:50:06.617191 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 1/1] 10.222.0.98 () {60 vars in 1156 bytes} [Fri Aug 26 15:50:02 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4509 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 26 15:50:06.633701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b3331391-e388-46d5-891d-79bfeb04dd80 tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] Calling method '.version_select at 0x7fbd1f1498b0>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:06.991902 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b3331391-e388-46d5-891d-79bfeb04dd80 tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/fd85651e-091a-41f6-a775-34c20d7bfa92" status: 200 len: 353 microversion: 2.1 time: 0.361491 Aug 26 15:50:06.991902 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 2/2] 10.222.0.98 () {58 vars in 1245 bytes} [Fri Aug 26 15:50:06 2022] GET /compute/v2.1/os-volumes/fd85651e-091a-41f6-a775-34c20d7bfa92 => generated 353 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:06.998836 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f58959ab-eb82-4e9a-9805-418c36d95a13 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] Calling method '.version_select at 0x7fbd1f149f70>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:07.190190 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-086c80c0-3b08-4562-92ff-09c2972454ca tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.468537 Aug 26 15:50:07.191144 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 1/3] 10.222.0.98 () {60 vars in 1155 bytes} [Fri Aug 26 15:50:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4471 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 26 15:50:07.205740 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d9812535-5cb7-4e57-a5cc-d22ddcc39c05 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1f1448b0>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:07.246257 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f58959ab-eb82-4e9a-9805-418c36d95a13 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/788a30ed-78f3-4c7e-b293-40f4792b632c" status: 200 len: 351 microversion: 2.1 time: 0.252505 Aug 26 15:50:07.246257 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 3/4] 10.222.0.98 () {58 vars in 1245 bytes} [Fri Aug 26 15:50:06 2022] GET /compute/v2.1/os-volumes/788a30ed-78f3-4c7e-b293-40f4792b632c => generated 351 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:07.393281 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d9812535-5cb7-4e57-a5cc-d22ddcc39c05 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863" status: 200 len: 344 microversion: 2.1 time: 0.191896 Aug 26 15:50:07.394718 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 2/5] 10.222.0.98 () {58 vars in 1245 bytes} [Fri Aug 26 15:50:07 2022] GET /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:08.004996 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b7214e8f-0801-48e7-a405-d42f4c565b41 tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] Calling method '.version_select at 0x7fbd1f15f700>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:08.129313 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b7214e8f-0801-48e7-a405-d42f4c565b41 tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/fd85651e-091a-41f6-a775-34c20d7bfa92" status: 200 len: 354 microversion: 2.1 time: 0.123754 Aug 26 15:50:08.129313 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 4/6] 10.222.0.98 () {58 vars in 1245 bytes} [Fri Aug 26 15:50:07 2022] GET /compute/v2.1/os-volumes/fd85651e-091a-41f6-a775-34c20d7bfa92 => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:08.139019 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-fa3ad8a2-af45-42b0-8adb-e6bb371c9cce tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] Calling method '.version_select at 0x7fbd1f144f70>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:08.386331 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-fa3ad8a2-af45-42b0-8adb-e6bb371c9cce tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/fd85651e-091a-41f6-a775-34c20d7bfa92" status: 200 len: 354 microversion: 2.1 time: 0.251773 Aug 26 15:50:08.386968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 3/7] 10.222.0.98 () {58 vars in 1245 bytes} [Fri Aug 26 15:50:08 2022] GET /compute/v2.1/os-volumes/fd85651e-091a-41f6-a775-34c20d7bfa92 => generated 354 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:50:08.413547 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-dd9e9936-3953-4c6e-af7f-21d80da72175 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1f149c10>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:08.417008 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d2de389f-3e3b-4997-9cb4-34f6286873d1 tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] Calling method '.version_select at 0x7fbd1f15b700>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:08.559510 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-dd9e9936-3953-4c6e-af7f-21d80da72175 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863" status: 200 len: 345 microversion: 2.1 time: 0.156822 Aug 26 15:50:08.566949 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 5/8] 10.222.0.98 () {58 vars in 1245 bytes} [Fri Aug 26 15:50:08 2022] GET /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 => generated 345 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:08.579581 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-94af3fa6-f863-441f-95a3-10b9cfb55c7a tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Action: 'create', calling method: .version_select at 0x7fbd1f271ee0>, body: {"snapshot": {"volume_id": "41d7dfd4-b5fc-47d4-9e35-16d45bfb4863", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1347230791"}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:08.928369 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d2de389f-3e3b-4997-9cb4-34f6286873d1 tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/fd85651e-091a-41f6-a775-34c20d7bfa92" status: 202 len: 0 microversion: 2.1 time: 0.520286 Aug 26 15:50:08.931852 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 4/9] 10.222.0.98 () {58 vars in 1248 bytes} [Fri Aug 26 15:50:08 2022] DELETE /compute/v2.1/os-volumes/fd85651e-091a-41f6-a775-34c20d7bfa92 => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 15:50:08.939743 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-404f2c6b-4467-4d2a-9a35-d9d36aa62bde tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] Calling method '.version_select at 0x7fbd1f144c10>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:09.139200 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-404f2c6b-4467-4d2a-9a35-d9d36aa62bde tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/fd85651e-091a-41f6-a775-34c20d7bfa92" status: 200 len: 353 microversion: 2.1 time: 0.202673 Aug 26 15:50:09.139200 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 5/10] 10.222.0.98 () {58 vars in 1245 bytes} [Fri Aug 26 15:50:08 2022] GET /compute/v2.1/os-volumes/fd85651e-091a-41f6-a775-34c20d7bfa92 => generated 353 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:50:09.650574 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-94af3fa6-f863-441f-95a3-10b9cfb55c7a tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.075837 Aug 26 15:50:09.651442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 6/11] 10.222.0.98 () {60 vars in 1162 bytes} [Fri Aug 26 15:50:08 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:09.662158 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3862ddd4-8267-4c15-b5f1-28de0cd244ae tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1f270ee0>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:09.734902 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3862ddd4-8267-4c15-b5f1-28de0cd244ae tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098" status: 200 len: 287 microversion: 2.1 time: 0.076813 Aug 26 15:50:09.737497 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 6/12] 10.222.0.98 () {58 vars in 1251 bytes} [Fri Aug 26 15:50:09 2022] GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:09.746325 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7cb3539d-42aa-4857-8f17-c13fe0db0526 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1f0e8040>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:09.876098 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7cb3539d-42aa-4857-8f17-c13fe0db0526 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.133350 Aug 26 15:50:09.878945 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 7/13] 10.222.0.98 () {58 vars in 1140 bytes} [Fri Aug 26 15:50:09 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:09.893019 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0c647c5b-5f09-4c8e-b588-fcd04e94a0c1 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1f15b310>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:09.991390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7000120e-35db-4c99-a78b-61142be7af3e tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] Calling method '.version_select at 0x7fbd1f15fc10>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:10.016182 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0c647c5b-5f09-4c8e-b588-fcd04e94a0c1 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098" status: 200 len: 287 microversion: 2.1 time: 0.130199 Aug 26 15:50:10.016746 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 7/14] 10.222.0.98 () {58 vars in 1251 bytes} [Fri Aug 26 15:50:09 2022] GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098 => generated 287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:10.083731 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7000120e-35db-4c99-a78b-61142be7af3e tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/f9e797b2-d7af-474a-9dad-471c12231eda" status: 200 len: 351 microversion: 2.1 time: 0.096601 Aug 26 15:50:10.083731 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 8/15] 10.222.0.98 () {58 vars in 1245 bytes} [Fri Aug 26 15:50:09 2022] GET /compute/v2.1/os-volumes/f9e797b2-d7af-474a-9dad-471c12231eda => generated 351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:10.159082 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c5d81f06-0088-4364-8063-c59470a96f27 tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] Calling method '.version_select at 0x7fbd1f144790>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:10.355297 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-c5d81f06-0088-4364-8063-c59470a96f27 tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] HTTP exception thrown: Volume fd85651e-091a-41f6-a775-34c20d7bfa92 could not be found. Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c5d81f06-0088-4364-8063-c59470a96f27 tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] Request method failure captured: Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: GET /compute/v2.1/os-volumes/fd85651e-091a-41f6-a775-34c20d7bfa92 HTTP/1.1 Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOuqJ_sJ55PfXV6DOCUEe-8Stac94MIrTtNf8uxaFvyQiEPBZOyZshn2MkyZludC5oVaGjJPP0uj18PFG1mAYGELt9jBzft2G0Qk3NnHXQvAN3huUGpSwocDX_HN-TuvpJSyYLg_ToZ9P_oT1_iZM8PRAbMJh1BLuebb__0ILDZrBwo Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: d59842f7ab92458282236e743cf4b436 Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-VolumesGetTestJSON-891596073 Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:50:10.359415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:50:10.360598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d59842f7ab92458282236e743cf4b436"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d59842f7ab92458282236e743cf4b436", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d59842f7ab92458282236e743cf4b436"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d59842f7ab92458282236e743cf4b436"}]}] Aug 26 15:50:10.360598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-VolumesGetTestJSON-891596073 Aug 26 15:50:10.360598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: d59842f7ab92458282236e743cf4b436 Aug 26 15:50:10.360598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-VolumesGetTestJSON-891596073 Aug 26 15:50:10.360598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-VolumesGetTestJSON-891596073-project Aug 26 15:50:10.360598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:50:10.360598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:50:10.360598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 90d2721f1c1f48d28078a2d3c338fcd5 Aug 26 15:50:10.360598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-VolumesGetTestJSON-891596073-project Aug 26 15:50:10.360598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: Aug 26 15:50:10.360598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Volume fd85651e-091a-41f6-a775-34c20d7bfa92 could not be found. Aug 26 15:50:10.360598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': 'fd85651e-091a-41f6-a775-34c20d7bfa92'} Aug 26 15:50:10.360598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fd85651e-091a-41f6-a775-34c20d7bfa92 could not be found. (HTTP 404) (Request-ID: req-6b6a8813-60fa-4652-8b5d-d6c715f6a984) Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:10.361272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 15:50:10.362234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fd85651e-091a-41f6-a775-34c20d7bfa92 could not be found. Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 15:50:10.363356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:50:10.364394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fd85651e-091a-41f6-a775-34c20d7bfa92 could not be found. Aug 26 15:50:10.364394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:10.364394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:10.364394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:10.364394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:10.364394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:10.364394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:10.364394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:50:10.364394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:50:10.364394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fd85651e-091a-41f6-a775-34c20d7bfa92 could not be found. Aug 26 15:50:10.364394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:10.366829 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c5d81f06-0088-4364-8063-c59470a96f27 tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] Returning 404 to user: Volume fd85651e-091a-41f6-a775-34c20d7bfa92 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:10.367968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c5d81f06-0088-4364-8063-c59470a96f27 tempest-VolumesGetTestJSON-891596073 tempest-VolumesGetTestJSON-891596073-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/fd85651e-091a-41f6-a775-34c20d7bfa92" status: 404 len: 109 microversion: 2.1 time: 0.218447 Aug 26 15:50:10.373274 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 8/16] 10.222.0.98 () {58 vars in 1245 bytes} [Fri Aug 26 15:50:10 2022] GET /compute/v2.1/os-volumes/fd85651e-091a-41f6-a775-34c20d7bfa92 => generated 109 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:50:11.033224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a5cac322-177f-4d50-92e5-e2fdf748d49b tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1f15f790>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:11.080788 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a5cac322-177f-4d50-92e5-e2fdf748d49b tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098" status: 200 len: 287 microversion: 2.1 time: 0.053367 Aug 26 15:50:11.086062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 9/17] 10.222.0.98 () {58 vars in 1251 bytes} [Fri Aug 26 15:50:11 2022] GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:11.841949 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-866eb5d9-0c35-47c6-8dfc-cebe2793b656 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Action: 'create', calling method: .version_select at 0x7fbd1fb1dee0>, body: {"keypair": {"name": "tempest-keypair-1750781866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8XIj19LAdRUVHYgj4N6dVlnJyG57mXcq04GrS1ItsuF42Tjiorwiigycxxd+FensGTNlRHMOwkFuKHHMVRYr4X8iBlPzY2CMr3IawVv4TYfCLnOiFlRHtk2scdKMC5XQ=="}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:11.949426 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-866eb5d9-0c35-47c6-8dfc-cebe2793b656 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Getting quotas for project bc372e59524442debba38c57df458071. Resources: {'key_pairs'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:50:11.961820 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-866eb5d9-0c35-47c6-8dfc-cebe2793b656 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Getting quotas for user 6861433b9f4441fe842b506def255c58 and project bc372e59524442debba38c57df458071. Resources: {'key_pairs'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:50:12.096391 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b4990d85-e63f-4032-939b-df6644039c8a tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1f149790>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:12.178698 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b4990d85-e63f-4032-939b-df6644039c8a tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098" status: 200 len: 287 microversion: 2.1 time: 0.085063 Aug 26 15:50:12.179502 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 10/18] 10.222.0.98 () {58 vars in 1251 bytes} [Fri Aug 26 15:50:12 2022] GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:50:12.211180 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-866eb5d9-0c35-47c6-8dfc-cebe2793b656 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.770677 Aug 26 15:50:12.211788 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 9/19] 10.222.0.98 () {60 vars in 1159 bytes} [Fri Aug 26 15:50:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:13.192430 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-909688af-420a-4966-8c61-827758806216 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1f15f8b0>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:13.253188 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-909688af-420a-4966-8c61-827758806216 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098" status: 200 len: 287 microversion: 2.1 time: 0.064060 Aug 26 15:50:13.256632 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 11/20] 10.222.0.98 () {58 vars in 1251 bytes} [Fri Aug 26 15:50:13 2022] GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:14.267617 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2c6c4059-1574-449e-8e7d-8ecb64a76bf2 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1f04a1f0>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:14.357832 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2c6c4059-1574-449e-8e7d-8ecb64a76bf2 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098" status: 200 len: 288 microversion: 2.1 time: 0.094887 Aug 26 15:50:14.366606 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 10/21] 10.222.0.98 () {58 vars in 1251 bytes} [Fri Aug 26 15:50:14 2022] GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098 => generated 288 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:14.380612 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b2439e0c-7f72-4641-99de-0762a1093d1d tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1f15faf0>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:14.527451 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f155b3a7-ccac-40f8-82bf-92b4555b60e4 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] Calling method '.version_select at 0x7fbd1f04a8b0>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:14.742890 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b2439e0c-7f72-4641-99de-0762a1093d1d tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "DELETE /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098" status: 202 len: 0 microversion: 2.1 time: 0.377259 Aug 26 15:50:14.746450 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 12/22] 10.222.0.98 () {58 vars in 1254 bytes} [Fri Aug 26 15:50:14 2022] DELETE /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:50:14.761455 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5173d01d-bf61-4d12-89b8-73d2cfc13d82 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1f149b80>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:14.831174 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f155b3a7-ccac-40f8-82bf-92b4555b60e4 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/f9e4dcb1-69c7-496c-bc68-9d503457b2fd" status: 200 len: 351 microversion: 2.1 time: 0.307516 Aug 26 15:50:14.839744 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 11/23] 10.222.0.98 () {58 vars in 1245 bytes} [Fri Aug 26 15:50:14 2022] GET /compute/v2.1/os-volumes/f9e4dcb1-69c7-496c-bc68-9d503457b2fd => generated 351 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:14.848810 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-007555a9-970a-4ecd-88ee-60f25b0920c3 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] Calling method '.version_select at 0x7fbd1f09dca0>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:14.916848 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5173d01d-bf61-4d12-89b8-73d2cfc13d82 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098" status: 200 len: 287 microversion: 2.1 time: 0.156265 Aug 26 15:50:14.918912 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 13/24] 10.222.0.98 () {58 vars in 1251 bytes} [Fri Aug 26 15:50:14 2022] GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098 => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:15.106310 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-007555a9-970a-4ecd-88ee-60f25b0920c3 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] 10.222.0.98 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.264986 Aug 26 15:50:15.108670 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 12/25] 10.222.0.98 () {58 vars in 1134 bytes} [Fri Aug 26 15:50:14 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:15.132418 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-33848a7c-8789-477e-bd2f-ed325e576b5a tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] Calling method '.version_select at 0x7fbd1f149e50>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:15.305464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-33848a7c-8789-477e-bd2f-ed325e576b5a tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] 10.222.0.98 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.186302 Aug 26 15:50:15.306398 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 14/26] 10.222.0.98 () {58 vars in 1149 bytes} [Fri Aug 26 15:50:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:15.329826 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-755d7f7d-465a-4223-8af6-125583229f81 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] Calling method '.version_select at 0x7fbd1f0551f0>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:15.551361 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-755d7f7d-465a-4223-8af6-125583229f81 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] 10.222.0.98 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.231679 Aug 26 15:50:15.551361 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 13/27] 10.222.0.98 () {58 vars in 1134 bytes} [Fri Aug 26 15:50:15 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:15.565400 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-2868a91d-703b-4159-a28e-1132924ec577 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] Calling method '.version_select at 0x7fbd1f149dc0>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:15.728551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-2868a91d-703b-4159-a28e-1132924ec577 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] 10.222.0.98 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.168928 Aug 26 15:50:15.729278 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 15/28] 10.222.0.98 () {58 vars in 1167 bytes} [Fri Aug 26 15:50:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:15.742924 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-dace33d5-ff48-49b7-b649-41560c72fd50 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] Calling method '.version_select at 0x7fbd1f055c10>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:15.933420 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-dace33d5-ff48-49b7-b649-41560c72fd50 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.194186 Aug 26 15:50:15.933981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 14/29] 10.222.0.98 () {58 vars in 1170 bytes} [Fri Aug 26 15:50:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:15.948817 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f4e7959c-2e18-4adf-8269-2b7b3d836ab1 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1f0e80d0>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:15.957274 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0dec3323-cf0c-4d85-bf45-2b97208b8726 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] Calling method '.version_select at 0x7fbd1f04a280>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:15.993790 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-f4e7959c-2e18-4adf-8269-2b7b3d836ab1 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] HTTP exception thrown: Snapshot 5538a2a0-8b22-42a4-996b-68c393ca2098 could not be found. Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f4e7959c-2e18-4adf-8269-2b7b3d836ab1 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Request method failure captured: Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098 HTTP/1.1 Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOuqnRxYItWfItUZrjHCRnTnszHsmruKHLGySxkQEYJUlviqvYpHpGH511j1LveLRbgxxjcMj-wcDjlZ4TikNslZlRJUU561l4PE3I8aW2qj-QR8TPXC1m3ttv7OG0i9rVx_P1YBVC4XF3QPiQd1ImDp6R1H8_FCCYe05dr3bBRu74k Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: 6110b6959363437c91a112be1b52b230 Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1701112969 Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:50:16.006497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:50:16.013505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/6110b6959363437c91a112be1b52b230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_6110b6959363437c91a112be1b52b230", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6110b6959363437c91a112be1b52b230"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6110b6959363437c91a112be1b52b230"}]}] Aug 26 15:50:16.013505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1701112969 Aug 26 15:50:16.013505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: 6110b6959363437c91a112be1b52b230 Aug 26 15:50:16.013505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1701112969 Aug 26 15:50:16.013505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-VolumesSnapshotsTestJSON-1701112969-project Aug 26 15:50:16.013505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:50:16.013505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:50:16.013505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 0072d0b0c39a4c2384f5c6e08c1303b2 Aug 26 15:50:16.013505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1701112969-project Aug 26 15:50:16.013505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: Aug 26 15:50:16.013505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Snapshot 5538a2a0-8b22-42a4-996b-68c393ca2098 could not be found. Aug 26 15:50:16.013505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '5538a2a0-8b22-42a4-996b-68c393ca2098'} Aug 26 15:50:16.013505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5538a2a0-8b22-42a4-996b-68c393ca2098 could not be found. (HTTP 404) (Request-ID: req-45e402e9-91e0-48ee-b3cf-1bde02c25db1) Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:16.015556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 15:50:16.016894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5538a2a0-8b22-42a4-996b-68c393ca2098 could not be found. Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 26 15:50:16.018361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:50:16.019641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5538a2a0-8b22-42a4-996b-68c393ca2098 could not be found. Aug 26 15:50:16.019641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:16.019641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:16.019641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:16.019641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:16.019641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:16.019641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:16.019641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:50:16.019641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:50:16.019641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5538a2a0-8b22-42a4-996b-68c393ca2098 could not be found. Aug 26 15:50:16.019641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:16.019641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f4e7959c-2e18-4adf-8269-2b7b3d836ab1 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Returning 404 to user: Snapshot 5538a2a0-8b22-42a4-996b-68c393ca2098 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:16.019641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f4e7959c-2e18-4adf-8269-2b7b3d836ab1 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098" status: 404 len: 111 microversion: 2.1 time: 0.079623 Aug 26 15:50:16.026529 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 16/30] 10.222.0.98 () {58 vars in 1251 bytes} [Fri Aug 26 15:50:15 2022] GET /compute/v2.1/os-snapshots/5538a2a0-8b22-42a4-996b-68c393ca2098 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:50:16.028186 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-eba9b362-8ba4-42c2-9c75-7ff4bbe02082 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1f0f4160>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:16.117384 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0dec3323-cf0c-4d85-bf45-2b97208b8726 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.173400 Aug 26 15:50:16.134244 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 15/31] 10.222.0.98 () {58 vars in 1155 bytes} [Fri Aug 26 15:50:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:16.145904 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-63ddb679-d421-42cc-baab-0a18d3e24aac tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] Calling method '.version_select at 0x7fbd1f0604c0>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:16.436210 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-eba9b362-8ba4-42c2-9c75-7ff4bbe02082 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863" status: 202 len: 0 microversion: 2.1 time: 0.419116 Aug 26 15:50:16.436993 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 17/32] 10.222.0.98 () {58 vars in 1248 bytes} [Fri Aug 26 15:50:16 2022] DELETE /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:50:16.446003 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-082ca99e-f56d-4c7a-a02a-af31de50c499 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1f0f4700>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:16.565210 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-63ddb679-d421-42cc-baab-0a18d3e24aac tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.429210 Aug 26 15:50:16.584996 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 16/33] 10.222.0.98 () {58 vars in 1188 bytes} [Fri Aug 26 15:50:16 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:16.592982 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-cbed1877-287c-4518-bf7d-020de9c9c731 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] Calling method '.version_select at 0x7fbd1f04a4c0>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:16.715171 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-082ca99e-f56d-4c7a-a02a-af31de50c499 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863" status: 200 len: 344 microversion: 2.1 time: 0.269279 Aug 26 15:50:16.715171 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 18/34] 10.222.0.98 () {58 vars in 1245 bytes} [Fri Aug 26 15:50:16 2022] GET /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 => generated 344 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:50:16.833840 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-cbed1877-287c-4518-bf7d-020de9c9c731 tempest-VolumesTestJSON-208844798 tempest-VolumesTestJSON-208844798-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.247473 Aug 26 15:50:16.834502 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 17/35] 10.222.0.98 () {58 vars in 1155 bytes} [Fri Aug 26 15:50:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:17.042638 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-804653170", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6bb34042-8beb-46ad-9c5c-3a292ab0e4d8"}], "security_groups": [{"name": "tempest-securitygroup--479195923"}], "key_name": "tempest-keypair-1750781866", "user_data": "}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:17.070066 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-493439261", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:17.262039 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.network.neutron [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] validate_networks() for [('cab596ab-7d04-4922-b3cc-a5bd19fc2e98', None, None, None, None, None)] {{(pid=127697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:50:17.315429 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.network.neutron [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] validate_networks() for [('6bb34042-8beb-46ad-9c5c-3a292ab0e4d8', None, None, None, None, None)] {{(pid=127698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:50:18.559763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Flavor limits 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:50:18.559763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Image limits 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:50:18.559763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Flavor pref 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:50:18.559763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Image pref 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:50:18.559763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:50:18.574322 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:18.574806 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:18.575241 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:18.576578 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:18.577036 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:18.577461 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:18.625738 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Flavor limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:50:18.626246 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Image limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:50:18.626620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Flavor pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:50:18.627027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Image pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:50:18.627433 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:50:18.644779 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:18.645044 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Getting quotas for project 853df33daae14bd9825788afd555e11a. Resources: {'ram', 'cores', 'instances'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:50:18.645136 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:18.645136 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:18.645136 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:18.645136 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:18.645439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:18.656238 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Getting quotas for user 5c01a893d3ab42cc97508768791ff38e and project 853df33daae14bd9825788afd555e11a. Resources: {'ram', 'cores', 'instances'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:50:18.670953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Going to run 1 instances... {{(pid=127697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:50:18.674272 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:50:18.695795 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Getting quotas for project bc372e59524442debba38c57df458071. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:50:18.695795 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Getting quotas for user 6861433b9f4441fe842b506def255c58 and project bc372e59524442debba38c57df458071. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:50:18.695795 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Going to run 1 instances... {{(pid=127698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:50:18.696114 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:50:18.890913 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a572d589-95ef-48f6-8d82-090477185802 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.092542 Aug 26 15:50:18.892133 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 19/36] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:50:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 15:50:18.953776 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2c524480-7e05-4a40-a7e8-a1eca9bb7959 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.918058 Aug 26 15:50:18.954441 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 18/37] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:50:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:50:18.960803 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ec7a81d5-f6c4-4bde-a877-f32cbac2f637 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1ef870d0>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:18.998232 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-700297483", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "networks": [{"uuid": "4a7b79a5-e7ba-4e8e-9ad0-1d926f035cc9"}]}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:19.067787 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ec7a81d5-f6c4-4bde-a877-f32cbac2f637 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863" status: 200 len: 344 microversion: 2.1 time: 0.111423 Aug 26 15:50:19.069016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 19/38] 10.222.0.98 () {58 vars in 1245 bytes} [Fri Aug 26 15:50:18 2022] GET /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 => generated 344 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:19.075708 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a365b286-04fc-4331-a88d-d48fce2cadbd tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:19.076856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a365b286-04fc-4331-a88d-d48fce2cadbd tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:19.131003 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.network.neutron [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] validate_networks() for [('4a7b79a5-e7ba-4e8e-9ad0-1d926f035cc9', None, None, None, None, None)] {{(pid=127697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:50:19.201679 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-a365b286-04fc-4331-a88d-d48fce2cadbd tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:19.216500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-a365b286-04fc-4331-a88d-d48fce2cadbd tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1221 microversion: 2.1 time: 0.145944 Aug 26 15:50:19.217246 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 20/39] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:19 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1221 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:19.222342 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-73090eb5-38bb-49e3-b6f4-b9cd04df20fb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:19.223305 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-73090eb5-38bb-49e3-b6f4-b9cd04df20fb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:19.286446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-73090eb5-38bb-49e3-b6f4-b9cd04df20fb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:19.299015 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-73090eb5-38bb-49e3-b6f4-b9cd04df20fb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1237 microversion: 2.1 time: 0.077019 Aug 26 15:50:19.299015 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 21/40] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:19 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1237 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:19.583623 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Flavor limits 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:50:19.584288 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Image limits 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:50:19.584731 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Flavor pref 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:50:19.585302 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Image pref 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:50:19.585848 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:50:19.596595 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:19.597295 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:19.597831 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:19.598627 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:19.599168 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:19.599728 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:19.619408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Getting quotas for project 35ef4da23ec44ed2a75e20f8cd365691. Resources: {'ram', 'cores', 'instances'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:50:19.636179 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Getting quotas for user 72dc0c14d61e4bae9aaa31bf46cb1e08 and project 35ef4da23ec44ed2a75e20f8cd365691. Resources: {'ram', 'cores', 'instances'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:50:19.674723 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Going to run 1 instances... {{(pid=127697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:50:19.680028 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:50:19.794078 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2100636201", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:19.871484 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.network.neutron [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] validate_networks() for [('cab596ab-7d04-4922-b3cc-a5bd19fc2e98', None, None, None, None, None)] {{(pid=127698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:50:19.916976 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5c1db029-2cbc-420e-999d-b0c3940cc7f7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.023389 Aug 26 15:50:19.927787 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 20/41] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:50:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:50:19.942440 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-ac3b43c4-3974-4602-ae94-5c92cbf01394 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:19.942440 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ac3b43c4-3974-4602-ae94-5c92cbf01394 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:20.134114 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ac3b43c4-3974-4602-ae94-5c92cbf01394 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:20.166863 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-ac3b43c4-3974-4602-ae94-5c92cbf01394 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1214 microversion: 2.1 time: 0.232309 Aug 26 15:50:20.168895 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 21/42] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:19 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1214 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:20.179778 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-88c61e3c-6746-4931-82d9-7bf7f97b55fe tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1e7ca550>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:20.290441 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-88c61e3c-6746-4931-82d9-7bf7f97b55fe tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] HTTP exception thrown: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-88c61e3c-6746-4931-82d9-7bf7f97b55fe tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Request method failure captured: Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 HTTP/1.1 Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOuqnRxYItWfItUZrjHCRnTnszHsmruKHLGySxkQEYJUlviqvYpHpGH511j1LveLRbgxxjcMj-wcDjlZ4TikNslZlRJUU561l4PE3I8aW2qj-QR8TPXC1m3ttv7OG0i9rVx_P1YBVC4XF3QPiQd1ImDp6R1H8_FCCYe05dr3bBRu74k Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: 6110b6959363437c91a112be1b52b230 Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1701112969 Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:50:20.295930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:50:20.297128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/6110b6959363437c91a112be1b52b230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_6110b6959363437c91a112be1b52b230", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6110b6959363437c91a112be1b52b230"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6110b6959363437c91a112be1b52b230"}]}] Aug 26 15:50:20.297128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1701112969 Aug 26 15:50:20.297128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: 6110b6959363437c91a112be1b52b230 Aug 26 15:50:20.297128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1701112969 Aug 26 15:50:20.297128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-VolumesSnapshotsTestJSON-1701112969-project Aug 26 15:50:20.297128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:50:20.297128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:50:20.297128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 0072d0b0c39a4c2384f5c6e08c1303b2 Aug 26 15:50:20.297128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1701112969-project Aug 26 15:50:20.297128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: Aug 26 15:50:20.297128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. Aug 26 15:50:20.297128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '41d7dfd4-b5fc-47d4-9e35-16d45bfb4863'} Aug 26 15:50:20.297128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. (HTTP 404) (Request-ID: req-eba82720-3701-4d20-b5d1-cb7d8f054bd4) Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:20.297797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 15:50:20.298745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 15:50:20.301408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:50:20.304551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. Aug 26 15:50:20.304551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.304551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:20.304551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.304551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:20.304551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:20.304551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:20.304551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:50:20.304551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:50:20.304551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. Aug 26 15:50:20.304551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.304551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-88c61e3c-6746-4931-82d9-7bf7f97b55fe tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Returning 404 to user: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:20.304551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-88c61e3c-6746-4931-82d9-7bf7f97b55fe tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863" status: 404 len: 109 microversion: 2.1 time: 0.127441 Aug 26 15:50:20.304551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 22/43] 10.222.0.98 () {58 vars in 1245 bytes} [Fri Aug 26 15:50:20 2022] GET /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:50:20.311274 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b6555e19-5fcb-4d2f-a240-84e6fea5e7c5 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1e79a160>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:20.373304 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-b6555e19-5fcb-4d2f-a240-84e6fea5e7c5 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] HTTP exception thrown: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b6555e19-5fcb-4d2f-a240-84e6fea5e7c5 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Request method failure captured: Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: DELETE /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 HTTP/1.1 Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOuqnRxYItWfItUZrjHCRnTnszHsmruKHLGySxkQEYJUlviqvYpHpGH511j1LveLRbgxxjcMj-wcDjlZ4TikNslZlRJUU561l4PE3I8aW2qj-QR8TPXC1m3ttv7OG0i9rVx_P1YBVC4XF3QPiQd1ImDp6R1H8_FCCYe05dr3bBRu74k Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: 6110b6959363437c91a112be1b52b230 Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1701112969 Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:50:20.375456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:50:20.376549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/6110b6959363437c91a112be1b52b230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_6110b6959363437c91a112be1b52b230", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6110b6959363437c91a112be1b52b230"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6110b6959363437c91a112be1b52b230"}]}] Aug 26 15:50:20.376549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1701112969 Aug 26 15:50:20.376549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: 6110b6959363437c91a112be1b52b230 Aug 26 15:50:20.376549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1701112969 Aug 26 15:50:20.376549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-VolumesSnapshotsTestJSON-1701112969-project Aug 26 15:50:20.376549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:50:20.376549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:50:20.376549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 0072d0b0c39a4c2384f5c6e08c1303b2 Aug 26 15:50:20.376549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1701112969-project Aug 26 15:50:20.376549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: Aug 26 15:50:20.376549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. Aug 26 15:50:20.376549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '41d7dfd4-b5fc-47d4-9e35-16d45bfb4863'} Aug 26 15:50:20.376549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. (HTTP 404) (Request-ID: req-013e0a47-a09f-40a5-992f-df4c3c4451f4) Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:20.377189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 15:50:20.378256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 15:50:20.379187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:50:20.381747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. Aug 26 15:50:20.381747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.381747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:20.381747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.381747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:20.381747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:20.381747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:20.381747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:50:20.381747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:50:20.381747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. Aug 26 15:50:20.381747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.381747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b6555e19-5fcb-4d2f-a240-84e6fea5e7c5 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Returning 404 to user: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:20.381747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b6555e19-5fcb-4d2f-a240-84e6fea5e7c5 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863" status: 404 len: 109 microversion: 2.1 time: 0.073039 Aug 26 15:50:20.381747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 23/44] 10.222.0.98 () {58 vars in 1248 bytes} [Fri Aug 26 15:50:20 2022] DELETE /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 15:50:20.386583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-81a69dfc-4b6c-44ff-9620-cb86c1261b25 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:20.387064 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-81a69dfc-4b6c-44ff-9620-cb86c1261b25 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:20.466990 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-81a69dfc-4b6c-44ff-9620-cb86c1261b25 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:20.492254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-81a69dfc-4b6c-44ff-9620-cb86c1261b25 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1237 microversion: 2.1 time: 0.096278 Aug 26 15:50:20.492254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 24/45] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:20 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:20.492254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-98f74467-d11e-4f10-b5ce-b7fa78eaf940 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Calling method '.version_select at 0x7fbd1e79adc0>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:20.545460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-98f74467-d11e-4f10-b5ce-b7fa78eaf940 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] HTTP exception thrown: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-98f74467-d11e-4f10-b5ce-b7fa78eaf940 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Request method failure captured: Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 HTTP/1.1 Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOuqnRxYItWfItUZrjHCRnTnszHsmruKHLGySxkQEYJUlviqvYpHpGH511j1LveLRbgxxjcMj-wcDjlZ4TikNslZlRJUU561l4PE3I8aW2qj-QR8TPXC1m3ttv7OG0i9rVx_P1YBVC4XF3QPiQd1ImDp6R1H8_FCCYe05dr3bBRu74k Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: 6110b6959363437c91a112be1b52b230 Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1701112969 Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:50:20.548192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:50:20.549292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/6110b6959363437c91a112be1b52b230"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_6110b6959363437c91a112be1b52b230", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6110b6959363437c91a112be1b52b230"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6110b6959363437c91a112be1b52b230"}]}] Aug 26 15:50:20.549292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1701112969 Aug 26 15:50:20.549292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: 6110b6959363437c91a112be1b52b230 Aug 26 15:50:20.549292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1701112969 Aug 26 15:50:20.549292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-VolumesSnapshotsTestJSON-1701112969-project Aug 26 15:50:20.549292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:50:20.549292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:50:20.549292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 0072d0b0c39a4c2384f5c6e08c1303b2 Aug 26 15:50:20.549292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1701112969-project Aug 26 15:50:20.549292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: Aug 26 15:50:20.549292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. Aug 26 15:50:20.549292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '41d7dfd4-b5fc-47d4-9e35-16d45bfb4863'} Aug 26 15:50:20.549292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. (HTTP 404) (Request-ID: req-734c7c8f-7585-4d6e-bf9c-53108e3655d8) Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:20.549984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 15:50:20.550970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 15:50:20.551953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:50:20.561711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. Aug 26 15:50:20.561711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.561711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:20.561711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.561711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:20.561711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:20.561711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:20.561711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:50:20.561711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:50:20.561711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. Aug 26 15:50:20.561711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:20.561711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-98f74467-d11e-4f10-b5ce-b7fa78eaf940 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] Returning 404 to user: Volume 41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:20.561711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-98f74467-d11e-4f10-b5ce-b7fa78eaf940 tempest-VolumesSnapshotsTestJSON-1701112969 tempest-VolumesSnapshotsTestJSON-1701112969-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863" status: 404 len: 109 microversion: 2.1 time: 0.073618 Aug 26 15:50:20.561711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 25/46] 10.222.0.98 () {58 vars in 1245 bytes} [Fri Aug 26 15:50:20 2022] GET /compute/v2.1/os-volumes/41d7dfd4-b5fc-47d4-9e35-16d45bfb4863 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:50:21.054849 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Flavor limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:50:21.056051 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Image limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:50:21.056582 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Flavor pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:50:21.057028 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Image pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:50:21.057464 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:50:21.105766 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:21.109781 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:21.110567 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:21.111765 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:21.120356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:21.120356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:21.163559 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Getting quotas for project 853df33daae14bd9825788afd555e11a. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:50:21.173938 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Getting quotas for user 5c01a893d3ab42cc97508768791ff38e and project 853df33daae14bd9825788afd555e11a. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:50:21.193000 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-cb29a5a4-0a2e-4f7b-a821-9493a40c01ed tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:21.193613 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-cb29a5a4-0a2e-4f7b-a821-9493a40c01ed tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:21.205181 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Going to run 1 instances... {{(pid=127698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:50:21.212658 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:50:21.274132 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cb29a5a4-0a2e-4f7b-a821-9493a40c01ed tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:21.281483 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-cb29a5a4-0a2e-4f7b-a821-9493a40c01ed tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1214 microversion: 2.1 time: 0.092716 Aug 26 15:50:21.297787 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 26/47] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:21 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:21.500408 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c6b7f5c4-f936-4754-b498-5322d8008c68 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.708597 Aug 26 15:50:21.508784 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 22/48] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:50:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:50:21.514372 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1f533a43-f74d-4d82-8b53-f4fbe6803759 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:21.515068 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1f533a43-f74d-4d82-8b53-f4fbe6803759 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:21.525802 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8a729886-17b8-483a-9f7f-f908decb961d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:21.529589 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-8a729886-17b8-483a-9f7f-f908decb961d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:21.682385 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1f533a43-f74d-4d82-8b53-f4fbe6803759 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:21.695262 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1f533a43-f74d-4d82-8b53-f4fbe6803759 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1222 microversion: 2.1 time: 0.184324 Aug 26 15:50:21.706213 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 27/49] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:21 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1222 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:21.736663 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8a729886-17b8-483a-9f7f-f908decb961d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:21.746386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-8a729886-17b8-483a-9f7f-f908decb961d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1237 microversion: 2.1 time: 0.236177 Aug 26 15:50:21.761575 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 23/50] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:21 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1237 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:22.311352 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-38a291fe-bec1-4feb-b56d-9b7eb4185cd3 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:22.312047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-38a291fe-bec1-4feb-b56d-9b7eb4185cd3 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:22.427940 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-38a291fe-bec1-4feb-b56d-9b7eb4185cd3 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:22.449131 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-38a291fe-bec1-4feb-b56d-9b7eb4185cd3 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1214 microversion: 2.1 time: 0.150280 Aug 26 15:50:22.454214 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 28/51] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:22 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:22.717993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-49fe8e25-a72a-4011-afde-b46dc96f02f0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:22.718623 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-49fe8e25-a72a-4011-afde-b46dc96f02f0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:22.774372 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1d37efa9-f1ce-40c4-ae3a-ddd76f0784da tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:22.774999 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1d37efa9-f1ce-40c4-ae3a-ddd76f0784da tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:22.793996 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-49fe8e25-a72a-4011-afde-b46dc96f02f0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:22.819086 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-49fe8e25-a72a-4011-afde-b46dc96f02f0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1222 microversion: 2.1 time: 0.093410 Aug 26 15:50:22.819086 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 24/52] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:22 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:22.843444 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1d37efa9-f1ce-40c4-ae3a-ddd76f0784da tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:22.850334 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1d37efa9-f1ce-40c4-ae3a-ddd76f0784da tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1237 microversion: 2.1 time: 0.080034 Aug 26 15:50:22.850899 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 29/53] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:22 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:23.476538 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5b00c5a4-3501-48a0-948e-55e71aa8bcd0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:23.477553 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5b00c5a4-3501-48a0-948e-55e71aa8bcd0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:23.491646 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b00c5a4-3501-48a0-948e-55e71aa8bcd0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:23.497353 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b00c5a4-3501-48a0-948e-55e71aa8bcd0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:23.497353 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b00c5a4-3501-48a0-948e-55e71aa8bcd0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:23.499431 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b00c5a4-3501-48a0-948e-55e71aa8bcd0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:23.500738 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b00c5a4-3501-48a0-948e-55e71aa8bcd0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:23.502359 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b00c5a4-3501-48a0-948e-55e71aa8bcd0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:23.791477 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-5b00c5a4-3501-48a0-948e-55e71aa8bcd0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:23.798339 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5b00c5a4-3501-48a0-948e-55e71aa8bcd0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1210 microversion: 2.1 time: 0.325010 Aug 26 15:50:23.799328 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 25/54] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:23 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1210 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:23.829005 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-94135b4d-bc5e-4e87-b4e1-5619c42e3e16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:23.833096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-94135b4d-bc5e-4e87-b4e1-5619c42e3e16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:23.841161 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-94135b4d-bc5e-4e87-b4e1-5619c42e3e16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:23.841745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-94135b4d-bc5e-4e87-b4e1-5619c42e3e16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:23.842193 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-94135b4d-bc5e-4e87-b4e1-5619c42e3e16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:23.842904 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-94135b4d-bc5e-4e87-b4e1-5619c42e3e16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:23.843900 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-94135b4d-bc5e-4e87-b4e1-5619c42e3e16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:23.844535 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-94135b4d-bc5e-4e87-b4e1-5619c42e3e16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:23.876989 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-11ce45c2-5bde-451f-bedb-935c1ea5425b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:23.877648 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-11ce45c2-5bde-451f-bedb-935c1ea5425b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:23.894465 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-11ce45c2-5bde-451f-bedb-935c1ea5425b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:23.894967 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-11ce45c2-5bde-451f-bedb-935c1ea5425b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:23.895433 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-11ce45c2-5bde-451f-bedb-935c1ea5425b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:23.903012 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-11ce45c2-5bde-451f-bedb-935c1ea5425b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:23.903677 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-11ce45c2-5bde-451f-bedb-935c1ea5425b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:23.904078 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-11ce45c2-5bde-451f-bedb-935c1ea5425b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:24.070140 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-11ce45c2-5bde-451f-bedb-935c1ea5425b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:24.080524 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-11ce45c2-5bde-451f-bedb-935c1ea5425b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1241 microversion: 2.1 time: 0.212156 Aug 26 15:50:24.084162 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 26/55] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:23 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1241 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:24.170931 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-94135b4d-bc5e-4e87-b4e1-5619c42e3e16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:24.194597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-94135b4d-bc5e-4e87-b4e1-5619c42e3e16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1226 microversion: 2.1 time: 0.369428 Aug 26 15:50:24.196851 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 30/56] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:23 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1226 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:24.827531 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-55c5c31f-7861-4926-82c7-fabc77e3f879 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:24.828778 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-55c5c31f-7861-4926-82c7-fabc77e3f879 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:24.835804 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-55c5c31f-7861-4926-82c7-fabc77e3f879 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:24.840709 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-55c5c31f-7861-4926-82c7-fabc77e3f879 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:24.840709 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-55c5c31f-7861-4926-82c7-fabc77e3f879 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:24.840709 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-55c5c31f-7861-4926-82c7-fabc77e3f879 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:24.840709 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-55c5c31f-7861-4926-82c7-fabc77e3f879 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:24.841118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-55c5c31f-7861-4926-82c7-fabc77e3f879 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:24.999959 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-55c5c31f-7861-4926-82c7-fabc77e3f879 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:25.021965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-55c5c31f-7861-4926-82c7-fabc77e3f879 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1266 microversion: 2.1 time: 0.197597 Aug 26 15:50:25.026055 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 27/57] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:24 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:25.106471 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-cc98363a-9b86-4395-927d-c39803c19bc4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:25.109970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-cc98363a-9b86-4395-927d-c39803c19bc4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:25.114984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cc98363a-9b86-4395-927d-c39803c19bc4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:25.115480 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cc98363a-9b86-4395-927d-c39803c19bc4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:25.116002 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cc98363a-9b86-4395-927d-c39803c19bc4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:25.116708 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cc98363a-9b86-4395-927d-c39803c19bc4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:25.117160 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cc98363a-9b86-4395-927d-c39803c19bc4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:25.117755 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cc98363a-9b86-4395-927d-c39803c19bc4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:25.210943 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cc98363a-9b86-4395-927d-c39803c19bc4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:25.217139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-71e23241-8cae-4575-a0bf-634e4276e280 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:25.222612 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-71e23241-8cae-4575-a0bf-634e4276e280 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:25.230688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-cc98363a-9b86-4395-927d-c39803c19bc4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1289 microversion: 2.1 time: 0.126809 Aug 26 15:50:25.231777 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 31/58] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:25 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1289 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:25.236674 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-71e23241-8cae-4575-a0bf-634e4276e280 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:25.237192 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-71e23241-8cae-4575-a0bf-634e4276e280 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:25.237831 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-71e23241-8cae-4575-a0bf-634e4276e280 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:25.238548 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-71e23241-8cae-4575-a0bf-634e4276e280 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:25.239161 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-71e23241-8cae-4575-a0bf-634e4276e280 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:25.239737 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-71e23241-8cae-4575-a0bf-634e4276e280 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:25.327130 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-71e23241-8cae-4575-a0bf-634e4276e280 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:25.335103 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-71e23241-8cae-4575-a0bf-634e4276e280 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1274 microversion: 2.1 time: 0.122067 Aug 26 15:50:25.335783 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 28/59] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:25 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:26.049522 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-276d8dff-cb9c-4a19-8e4b-5ba1e65e3cfb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:26.050305 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-276d8dff-cb9c-4a19-8e4b-5ba1e65e3cfb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:26.057349 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-276d8dff-cb9c-4a19-8e4b-5ba1e65e3cfb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:26.058630 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-276d8dff-cb9c-4a19-8e4b-5ba1e65e3cfb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:26.069355 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-276d8dff-cb9c-4a19-8e4b-5ba1e65e3cfb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:26.069355 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-276d8dff-cb9c-4a19-8e4b-5ba1e65e3cfb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:26.069355 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-276d8dff-cb9c-4a19-8e4b-5ba1e65e3cfb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:26.069355 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-276d8dff-cb9c-4a19-8e4b-5ba1e65e3cfb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:26.206984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-276d8dff-cb9c-4a19-8e4b-5ba1e65e3cfb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:26.218792 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-276d8dff-cb9c-4a19-8e4b-5ba1e65e3cfb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1274 microversion: 2.1 time: 0.178017 Aug 26 15:50:26.236103 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 32/60] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:26 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1274 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:26.269109 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-785f3418-07a9-4692-a591-dd8ee7d44bf0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:26.269973 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-785f3418-07a9-4692-a591-dd8ee7d44bf0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:26.287990 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-785f3418-07a9-4692-a591-dd8ee7d44bf0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:26.288505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-785f3418-07a9-4692-a591-dd8ee7d44bf0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:26.288998 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-785f3418-07a9-4692-a591-dd8ee7d44bf0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:26.294547 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-785f3418-07a9-4692-a591-dd8ee7d44bf0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:26.297373 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-785f3418-07a9-4692-a591-dd8ee7d44bf0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:26.298777 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-785f3418-07a9-4692-a591-dd8ee7d44bf0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:26.357650 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6b537ca9-000b-4cb3-a9f3-6beed5b5f3c3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:26.358558 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6b537ca9-000b-4cb3-a9f3-6beed5b5f3c3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:26.384408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b537ca9-000b-4cb3-a9f3-6beed5b5f3c3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:26.386117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b537ca9-000b-4cb3-a9f3-6beed5b5f3c3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:26.388971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b537ca9-000b-4cb3-a9f3-6beed5b5f3c3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:26.390460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b537ca9-000b-4cb3-a9f3-6beed5b5f3c3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:26.391640 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b537ca9-000b-4cb3-a9f3-6beed5b5f3c3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:26.393326 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b537ca9-000b-4cb3-a9f3-6beed5b5f3c3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:26.483937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-785f3418-07a9-4692-a591-dd8ee7d44bf0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:26.499622 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-785f3418-07a9-4692-a591-dd8ee7d44bf0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1297 microversion: 2.1 time: 0.248618 Aug 26 15:50:26.501844 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 29/61] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:26 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1297 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:26.701643 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6b537ca9-000b-4cb3-a9f3-6beed5b5f3c3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:26.713802 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6b537ca9-000b-4cb3-a9f3-6beed5b5f3c3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1282 microversion: 2.1 time: 0.360825 Aug 26 15:50:26.723180 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 33/62] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:26 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1282 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:27.175739 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8258242a-f48e-4337-92a2-4025aa1e5bb5 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Action: 'create', calling method: .version_select at 0x7fbd1e6990d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-493070087", "metadata": {"Type": "work"}}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8258242a-f48e-4337-92a2-4025aa1e5bb5 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Request method failure captured: Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 121 Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOvC67avuDZl3fTqbijN-_n7Wy2Iz_nJn-2FjQ7UBna6XVVZf8m7wLnqRfzDjs01nYbK5_ygt3O-DtEIDkqm6EKuS6LvMaLyPQpvNAow43wIOWaLxd2aIq2rR5nrG_HfKrAVTfPCzqdjwcvtaI3L4PLavPN4GIHwglMgYblGBvFc4PY Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: d0c8f1dcba8f46dfb7ce7ce9e099bbc3 Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:50:27.182006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:50:27.183742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d0c8f1dcba8f46dfb7ce7ce9e099bbc3", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}] Aug 26 15:50:27.183742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.183742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: d0c8f1dcba8f46dfb7ce7ce9e099bbc3 Aug 26 15:50:27.183742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.183742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-VolumesNegativeTest-573986552-project Aug 26 15:50:27.183742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:50:27.183742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:50:27.183742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 2f28260e27934437a1d2122849a0669a Aug 26 15:50:27.183742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-VolumesNegativeTest-573986552-project Aug 26 15:50:27.183742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Aug 26 15:50:27.183742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-493070087", "metadata": {"Type": "work"}}} Aug 26 15:50:27.183742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: Aug 26 15:50:27.183742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-493070087', 'metadata': {'Type': 'work'}}}} Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise error Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi '#$%' Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:27.189234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 15:50:27.191665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 15:50:27.192992 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 15:50:27.192992 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.192992 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8258242a-f48e-4337-92a2-4025aa1e5bb5 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:27.192992 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-8258242a-f48e-4337-92a2-4025aa1e5bb5 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.440131 Aug 26 15:50:27.192992 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 30/63] 10.222.0.98 () {60 vars in 1156 bytes} [Fri Aug 26 15:50:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 441 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 15:50:27.193691 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-876017c9-f423-49aa-8a85-64063e37e808 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Action: 'create', calling method: .version_select at 0x7fbd1e6645e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1771379615", "metadata": {"Type": "work"}}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-876017c9-f423-49aa-8a85-64063e37e808 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Request method failure captured: Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 120 Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOvC67avuDZl3fTqbijN-_n7Wy2Iz_nJn-2FjQ7UBna6XVVZf8m7wLnqRfzDjs01nYbK5_ygt3O-DtEIDkqm6EKuS6LvMaLyPQpvNAow43wIOWaLxd2aIq2rR5nrG_HfKrAVTfPCzqdjwcvtaI3L4PLavPN4GIHwglMgYblGBvFc4PY Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: d0c8f1dcba8f46dfb7ce7ce9e099bbc3 Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:50:27.198431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:50:27.199739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d0c8f1dcba8f46dfb7ce7ce9e099bbc3", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}] Aug 26 15:50:27.199739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.199739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: d0c8f1dcba8f46dfb7ce7ce9e099bbc3 Aug 26 15:50:27.199739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.199739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-VolumesNegativeTest-573986552-project Aug 26 15:50:27.199739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:50:27.199739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:50:27.199739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 2f28260e27934437a1d2122849a0669a Aug 26 15:50:27.199739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-VolumesNegativeTest-573986552-project Aug 26 15:50:27.199739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Aug 26 15:50:27.199739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1771379615", "metadata": {"Type": "work"}}} Aug 26 15:50:27.199739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: Aug 26 15:50:27.199739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1771379615', 'metadata': {'Type': 'work'}}}} Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise error Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi '0' Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:27.200436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 15:50:27.201674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 15:50:27.202581 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 15:50:27.202581 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.210718 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-876017c9-f423-49aa-8a85-64063e37e808 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:27.211598 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-876017c9-f423-49aa-8a85-64063e37e808 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021688 Aug 26 15:50:27.216175 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 34/64] 10.222.0.98 () {60 vars in 1156 bytes} [Fri Aug 26 15:50:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 15:50:27.222908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f2db3eb9-0fae-4c69-9722-5e060f4bc7d1 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Action: 'create', calling method: .version_select at 0x7fbd1e66bb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2084379503", "metadata": {"Type": "work"}}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f2db3eb9-0fae-4c69-9722-5e060f4bc7d1 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Request method failure captured: Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 119 Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOvC67avuDZl3fTqbijN-_n7Wy2Iz_nJn-2FjQ7UBna6XVVZf8m7wLnqRfzDjs01nYbK5_ygt3O-DtEIDkqm6EKuS6LvMaLyPQpvNAow43wIOWaLxd2aIq2rR5nrG_HfKrAVTfPCzqdjwcvtaI3L4PLavPN4GIHwglMgYblGBvFc4PY Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: d0c8f1dcba8f46dfb7ce7ce9e099bbc3 Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:50:27.227214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:50:27.228347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d0c8f1dcba8f46dfb7ce7ce9e099bbc3", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}] Aug 26 15:50:27.228347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.228347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: d0c8f1dcba8f46dfb7ce7ce9e099bbc3 Aug 26 15:50:27.228347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.228347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-VolumesNegativeTest-573986552-project Aug 26 15:50:27.228347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:50:27.228347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:50:27.228347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 2f28260e27934437a1d2122849a0669a Aug 26 15:50:27.228347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-VolumesNegativeTest-573986552-project Aug 26 15:50:27.228347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Aug 26 15:50:27.228347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2084379503", "metadata": {"Type": "work"}}} Aug 26 15:50:27.228347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: Aug 26 15:50:27.228347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2084379503', 'metadata': {'Type': 'work'}}}} Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise error Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi '' Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:27.229046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 15:50:27.230154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 15:50:27.231093 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 15:50:27.231093 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.231093 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f2db3eb9-0fae-4c69-9722-5e060f4bc7d1 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:27.235441 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f2db3eb9-0fae-4c69-9722-5e060f4bc7d1 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017397 Aug 26 15:50:27.238670 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 31/65] 10.222.0.98 () {60 vars in 1156 bytes} [Fri Aug 26 15:50:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 15:50:27.252661 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4d71e169-3819-4273-a89c-4337e7a4faa8 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Calling method '.version_select at 0x7fbd1e699d30>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:27.254509 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-40276d0f-b6b8-4284-9b5e-1158319b9cf7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:27.257180 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-40276d0f-b6b8-4284-9b5e-1158319b9cf7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:27.284924 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-40276d0f-b6b8-4284-9b5e-1158319b9cf7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:27.284924 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-40276d0f-b6b8-4284-9b5e-1158319b9cf7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:27.284924 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-40276d0f-b6b8-4284-9b5e-1158319b9cf7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:27.284924 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-40276d0f-b6b8-4284-9b5e-1158319b9cf7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:27.285243 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-40276d0f-b6b8-4284-9b5e-1158319b9cf7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:27.287341 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-40276d0f-b6b8-4284-9b5e-1158319b9cf7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:27.301815 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-4d71e169-3819-4273-a89c-4337e7a4faa8 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] HTTP exception thrown: Volume tempest-invalid-568447913 could not be found. Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4d71e169-3819-4273-a89c-4337e7a4faa8 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Request method failure captured: Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-568447913 HTTP/1.1 Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOvC67avuDZl3fTqbijN-_n7Wy2Iz_nJn-2FjQ7UBna6XVVZf8m7wLnqRfzDjs01nYbK5_ygt3O-DtEIDkqm6EKuS6LvMaLyPQpvNAow43wIOWaLxd2aIq2rR5nrG_HfKrAVTfPCzqdjwcvtaI3L4PLavPN4GIHwglMgYblGBvFc4PY Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: d0c8f1dcba8f46dfb7ce7ce9e099bbc3 Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:50:27.303847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:50:27.304972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d0c8f1dcba8f46dfb7ce7ce9e099bbc3", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}] Aug 26 15:50:27.304972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.304972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: d0c8f1dcba8f46dfb7ce7ce9e099bbc3 Aug 26 15:50:27.304972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.304972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-VolumesNegativeTest-573986552-project Aug 26 15:50:27.304972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:50:27.304972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:50:27.304972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 2f28260e27934437a1d2122849a0669a Aug 26 15:50:27.304972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-VolumesNegativeTest-573986552-project Aug 26 15:50:27.304972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: Aug 26 15:50:27.304972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Volume tempest-invalid-568447913 could not be found. Aug 26 15:50:27.304972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': 'tempest-invalid-568447913'} Aug 26 15:50:27.304972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-568447913 could not be found. (HTTP 404) (Request-ID: req-f963db05-9c49-48b9-87b2-d645886f7f4d) Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:27.305757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 15:50:27.312054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-568447913 could not be found. Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:50:27.313002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-568447913 could not be found. Aug 26 15:50:27.314620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.314620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:27.314620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.314620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.314620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:27.314620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:27.314620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:50:27.314620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:50:27.314620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-568447913 could not be found. Aug 26 15:50:27.314620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.314620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4d71e169-3819-4273-a89c-4337e7a4faa8 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Returning 404 to user: Volume tempest-invalid-568447913 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:27.314620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4d71e169-3819-4273-a89c-4337e7a4faa8 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/tempest-invalid-568447913" status: 404 len: 98 microversion: 2.1 time: 0.056606 Aug 26 15:50:27.314620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 32/66] 10.222.0.98 () {58 vars in 1215 bytes} [Fri Aug 26 15:50:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-568447913 => generated 98 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 26 15:50:27.318378 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e7b285b6-064c-4d51-a2c4-6718f37394a5 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005999 Aug 26 15:50:27.321372 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 33/67] 10.222.0.98 () {58 vars in 1140 bytes} [Fri Aug 26 15:50:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 26 15:50:27.344292 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-375b4c8a-eab7-4b4c-9772-9fdd09533b89 tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012572 Aug 26 15:50:27.344834 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 34/68] 10.222.0.98 () {58 vars in 1137 bytes} [Fri Aug 26 15:50:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 26 15:50:27.365656 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-73be1845-808c-4758-9dbd-f56fd3be04ba tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Calling method '.version_select at 0x7fbd1e6991f0>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:27.414773 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-40276d0f-b6b8-4284-9b5e-1158319b9cf7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:27.422638 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-73be1845-808c-4758-9dbd-f56fd3be04ba tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] HTTP exception thrown: Volume ad086886-25f3-4508-8ae4-f71fd5ca65a2 could not be found. Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-73be1845-808c-4758-9dbd-f56fd3be04ba tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Request method failure captured: Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: DELETE /compute/v2.1/os-volumes/ad086886-25f3-4508-8ae4-f71fd5ca65a2 HTTP/1.1 Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOvC67avuDZl3fTqbijN-_n7Wy2Iz_nJn-2FjQ7UBna6XVVZf8m7wLnqRfzDjs01nYbK5_ygt3O-DtEIDkqm6EKuS6LvMaLyPQpvNAow43wIOWaLxd2aIq2rR5nrG_HfKrAVTfPCzqdjwcvtaI3L4PLavPN4GIHwglMgYblGBvFc4PY Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: d0c8f1dcba8f46dfb7ce7ce9e099bbc3 Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:50:27.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:50:27.427545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d0c8f1dcba8f46dfb7ce7ce9e099bbc3", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}] Aug 26 15:50:27.427545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.427545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: d0c8f1dcba8f46dfb7ce7ce9e099bbc3 Aug 26 15:50:27.427545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.427545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-VolumesNegativeTest-573986552-project Aug 26 15:50:27.427545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:50:27.427545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:50:27.427545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 2f28260e27934437a1d2122849a0669a Aug 26 15:50:27.427545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-VolumesNegativeTest-573986552-project Aug 26 15:50:27.427545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: Aug 26 15:50:27.427545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Volume ad086886-25f3-4508-8ae4-f71fd5ca65a2 could not be found. Aug 26 15:50:27.427545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': 'ad086886-25f3-4508-8ae4-f71fd5ca65a2'} Aug 26 15:50:27.427545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad086886-25f3-4508-8ae4-f71fd5ca65a2 could not be found. (HTTP 404) (Request-ID: req-5d4c6e42-3fea-416b-9524-8d92c16122df) Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:27.428262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 15:50:27.429690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad086886-25f3-4508-8ae4-f71fd5ca65a2 could not be found. Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 15:50:27.432403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:50:27.434981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad086886-25f3-4508-8ae4-f71fd5ca65a2 could not be found. Aug 26 15:50:27.434981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.434981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:27.434981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.434981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.434981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:27.434981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:27.434981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:50:27.434981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:50:27.434981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad086886-25f3-4508-8ae4-f71fd5ca65a2 could not be found. Aug 26 15:50:27.434981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.434981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-73be1845-808c-4758-9dbd-f56fd3be04ba tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Returning 404 to user: Volume ad086886-25f3-4508-8ae4-f71fd5ca65a2 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:27.434981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-73be1845-808c-4758-9dbd-f56fd3be04ba tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/ad086886-25f3-4508-8ae4-f71fd5ca65a2" status: 404 len: 109 microversion: 2.1 time: 0.077471 Aug 26 15:50:27.434981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 35/69] 10.222.0.98 () {58 vars in 1248 bytes} [Fri Aug 26 15:50:27 2022] DELETE /compute/v2.1/os-volumes/ad086886-25f3-4508-8ae4-f71fd5ca65a2 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:50:27.449445 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-40276d0f-b6b8-4284-9b5e-1158319b9cf7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1272 microversion: 2.1 time: 0.209085 Aug 26 15:50:27.454299 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 35/70] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:27 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1272 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:27.466475 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-9b28132a-6e2e-4728-a8ac-a6dbdd36d48b tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Calling method '.version_select at 0x7fbd1e6ae5e0>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:27.527194 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-44aa4dd5-429c-4770-896a-65913c8c766f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:27.527784 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-44aa4dd5-429c-4770-896a-65913c8c766f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:27.531043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-9b28132a-6e2e-4728-a8ac-a6dbdd36d48b tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] HTTP exception thrown: Volume 55dbde77-2c42-4ab7-9a78-833e1f050837 could not be found. Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-9b28132a-6e2e-4728-a8ac-a6dbdd36d48b tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Request method failure captured: Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: GET /compute/v2.1/os-volumes/55dbde77-2c42-4ab7-9a78-833e1f050837 HTTP/1.1 Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOvC67avuDZl3fTqbijN-_n7Wy2Iz_nJn-2FjQ7UBna6XVVZf8m7wLnqRfzDjs01nYbK5_ygt3O-DtEIDkqm6EKuS6LvMaLyPQpvNAow43wIOWaLxd2aIq2rR5nrG_HfKrAVTfPCzqdjwcvtaI3L4PLavPN4GIHwglMgYblGBvFc4PY Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: d0c8f1dcba8f46dfb7ce7ce9e099bbc3 Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:50:27.533112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:50:27.534201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d0c8f1dcba8f46dfb7ce7ce9e099bbc3", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d0c8f1dcba8f46dfb7ce7ce9e099bbc3"}]}] Aug 26 15:50:27.534201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.534201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: d0c8f1dcba8f46dfb7ce7ce9e099bbc3 Aug 26 15:50:27.534201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-VolumesNegativeTest-573986552 Aug 26 15:50:27.534201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-VolumesNegativeTest-573986552-project Aug 26 15:50:27.534201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:50:27.534201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:50:27.534201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 2f28260e27934437a1d2122849a0669a Aug 26 15:50:27.534201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-VolumesNegativeTest-573986552-project Aug 26 15:50:27.534201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: Aug 26 15:50:27.534201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Volume 55dbde77-2c42-4ab7-9a78-833e1f050837 could not be found. Aug 26 15:50:27.534201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '55dbde77-2c42-4ab7-9a78-833e1f050837'} Aug 26 15:50:27.534201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55dbde77-2c42-4ab7-9a78-833e1f050837 could not be found. (HTTP 404) (Request-ID: req-47e9fab5-3a64-4386-ac62-196e81aeed5e) Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:27.534871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 15:50:27.537056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55dbde77-2c42-4ab7-9a78-833e1f050837 could not be found. Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 15:50:27.539461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:50:27.540446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55dbde77-2c42-4ab7-9a78-833e1f050837 could not be found. Aug 26 15:50:27.540446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.540446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:27.540446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.540446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:27.540446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:27.540446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:27.540446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:50:27.540446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:50:27.540446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55dbde77-2c42-4ab7-9a78-833e1f050837 could not be found. Aug 26 15:50:27.540446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:50:27.540446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-9b28132a-6e2e-4728-a8ac-a6dbdd36d48b tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] Returning 404 to user: Volume 55dbde77-2c42-4ab7-9a78-833e1f050837 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:27.540446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-9b28132a-6e2e-4728-a8ac-a6dbdd36d48b tempest-VolumesNegativeTest-573986552 tempest-VolumesNegativeTest-573986552-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/55dbde77-2c42-4ab7-9a78-833e1f050837" status: 404 len: 109 microversion: 2.1 time: 0.099903 Aug 26 15:50:27.540446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 36/71] 10.222.0.98 () {58 vars in 1245 bytes} [Fri Aug 26 15:50:27 2022] GET /compute/v2.1/os-volumes/55dbde77-2c42-4ab7-9a78-833e1f050837 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:50:27.547857 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44aa4dd5-429c-4770-896a-65913c8c766f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:27.556971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44aa4dd5-429c-4770-896a-65913c8c766f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:27.557521 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44aa4dd5-429c-4770-896a-65913c8c766f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:27.558604 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44aa4dd5-429c-4770-896a-65913c8c766f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:27.559209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44aa4dd5-429c-4770-896a-65913c8c766f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:27.559704 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44aa4dd5-429c-4770-896a-65913c8c766f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:27.734312 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-44aa4dd5-429c-4770-896a-65913c8c766f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:27.744347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-9b896b3c-b5f6-4f93-8d22-c3280b0f1cbf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:27.745231 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-9b896b3c-b5f6-4f93-8d22-c3280b0f1cbf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:27.762000 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-44aa4dd5-429c-4770-896a-65913c8c766f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1295 microversion: 2.1 time: 0.239541 Aug 26 15:50:27.762970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9b896b3c-b5f6-4f93-8d22-c3280b0f1cbf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:27.765191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9b896b3c-b5f6-4f93-8d22-c3280b0f1cbf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:27.776552 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9b896b3c-b5f6-4f93-8d22-c3280b0f1cbf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:27.776780 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 36/72] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:27 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1295 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:27.776864 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9b896b3c-b5f6-4f93-8d22-c3280b0f1cbf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:27.776864 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9b896b3c-b5f6-4f93-8d22-c3280b0f1cbf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:27.776864 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9b896b3c-b5f6-4f93-8d22-c3280b0f1cbf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:27.978399 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-9b896b3c-b5f6-4f93-8d22-c3280b0f1cbf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:27.988016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-9b896b3c-b5f6-4f93-8d22-c3280b0f1cbf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1280 microversion: 2.1 time: 0.248916 Aug 26 15:50:27.990704 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 37/73] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:27 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1280 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:28.479787 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7106ea04-1bb6-4a5e-899a-df9c1c9e4321 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:28.480394 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7106ea04-1bb6-4a5e-899a-df9c1c9e4321 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:28.500839 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7106ea04-1bb6-4a5e-899a-df9c1c9e4321 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:28.500839 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7106ea04-1bb6-4a5e-899a-df9c1c9e4321 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:28.501089 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7106ea04-1bb6-4a5e-899a-df9c1c9e4321 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:28.504979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7106ea04-1bb6-4a5e-899a-df9c1c9e4321 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:28.505465 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7106ea04-1bb6-4a5e-899a-df9c1c9e4321 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:28.505903 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7106ea04-1bb6-4a5e-899a-df9c1c9e4321 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:28.788701 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-48892747-c7fc-4ffc-818e-17efb0534484 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:28.788701 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-48892747-c7fc-4ffc-818e-17efb0534484 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:28.795386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-48892747-c7fc-4ffc-818e-17efb0534484 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:28.796524 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-48892747-c7fc-4ffc-818e-17efb0534484 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:28.796524 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-48892747-c7fc-4ffc-818e-17efb0534484 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:28.808787 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-48892747-c7fc-4ffc-818e-17efb0534484 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:28.809296 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-48892747-c7fc-4ffc-818e-17efb0534484 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:28.809755 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-48892747-c7fc-4ffc-818e-17efb0534484 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:29.209426 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-48892747-c7fc-4ffc-818e-17efb0534484 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:29.226208 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-48892747-c7fc-4ffc-818e-17efb0534484 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.442052 Aug 26 15:50:29.226940 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 38/74] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:28 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:29.231712 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3a57e8ea-ba26-4078-a458-e3107f51ede2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:29.233189 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3a57e8ea-ba26-4078-a458-e3107f51ede2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:29.240196 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3a57e8ea-ba26-4078-a458-e3107f51ede2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:29.240964 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3a57e8ea-ba26-4078-a458-e3107f51ede2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:29.241750 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3a57e8ea-ba26-4078-a458-e3107f51ede2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:29.242648 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3a57e8ea-ba26-4078-a458-e3107f51ede2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:29.243275 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3a57e8ea-ba26-4078-a458-e3107f51ede2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:29.243909 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3a57e8ea-ba26-4078-a458-e3107f51ede2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:29.293050 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7106ea04-1bb6-4a5e-899a-df9c1c9e4321 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:29.317094 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7106ea04-1bb6-4a5e-899a-df9c1c9e4321 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.840809 Aug 26 15:50:29.320261 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 37/75] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:28 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:29.721884 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3a57e8ea-ba26-4078-a458-e3107f51ede2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:29.744507 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3a57e8ea-ba26-4078-a458-e3107f51ede2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.516276 Aug 26 15:50:29.745313 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 39/76] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:29 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:30.259576 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b3db2378-c7df-4037-892c-29928c37b390 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:30.259576 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b3db2378-c7df-4037-892c-29928c37b390 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:30.263298 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=4 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:30.265763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b3db2378-c7df-4037-892c-29928c37b390 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:30.266463 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b3db2378-c7df-4037-892c-29928c37b390 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:30.267056 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b3db2378-c7df-4037-892c-29928c37b390 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:30.268178 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b3db2378-c7df-4037-892c-29928c37b390 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:30.270545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b3db2378-c7df-4037-892c-29928c37b390 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:30.270545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b3db2378-c7df-4037-892c-29928c37b390 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:30.339327 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1e4de3fd-b1c3-4774-910a-5a20bd4bfa4f tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:30.339970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-1e4de3fd-b1c3-4774-910a-5a20bd4bfa4f tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:30.352870 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1e4de3fd-b1c3-4774-910a-5a20bd4bfa4f tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:30.353361 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1e4de3fd-b1c3-4774-910a-5a20bd4bfa4f tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:30.353802 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1e4de3fd-b1c3-4774-910a-5a20bd4bfa4f tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:30.354501 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1e4de3fd-b1c3-4774-910a-5a20bd4bfa4f tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:30.369526 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1e4de3fd-b1c3-4774-910a-5a20bd4bfa4f tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:30.370090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1e4de3fd-b1c3-4774-910a-5a20bd4bfa4f tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:30.541047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b3db2378-c7df-4037-892c-29928c37b390 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:30.554027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b3db2378-c7df-4037-892c-29928c37b390 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.305240 Aug 26 15:50:30.555177 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 38/77] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:30 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:30.770137 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-698971cd-8d77-4c7a-a5f4-1dad42d17b8c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:30.771109 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-698971cd-8d77-4c7a-a5f4-1dad42d17b8c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:30.788449 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-698971cd-8d77-4c7a-a5f4-1dad42d17b8c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:30.795402 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-698971cd-8d77-4c7a-a5f4-1dad42d17b8c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:30.796211 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-698971cd-8d77-4c7a-a5f4-1dad42d17b8c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:30.797185 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-698971cd-8d77-4c7a-a5f4-1dad42d17b8c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:30.797866 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-698971cd-8d77-4c7a-a5f4-1dad42d17b8c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:30.798505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-698971cd-8d77-4c7a-a5f4-1dad42d17b8c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:31.059302 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1e4de3fd-b1c3-4774-910a-5a20bd4bfa4f tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:31.074020 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-1e4de3fd-b1c3-4774-910a-5a20bd4bfa4f tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.739123 Aug 26 15:50:31.078584 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 40/78] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:30 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:31.121094 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-698971cd-8d77-4c7a-a5f4-1dad42d17b8c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:31.133452 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-698971cd-8d77-4c7a-a5f4-1dad42d17b8c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.366999 Aug 26 15:50:31.137200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 39/79] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:30 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:31.583027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0a062984-4557-4502-acf0-3039ab2af9e1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:31.583700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0a062984-4557-4502-acf0-3039ab2af9e1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:31.586857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=4 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:31.595736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a062984-4557-4502-acf0-3039ab2af9e1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:31.605478 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a062984-4557-4502-acf0-3039ab2af9e1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:31.606118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a062984-4557-4502-acf0-3039ab2af9e1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:31.608077 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a062984-4557-4502-acf0-3039ab2af9e1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:31.611774 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a062984-4557-4502-acf0-3039ab2af9e1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:31.612539 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a062984-4557-4502-acf0-3039ab2af9e1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:32.171359 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0a062984-4557-4502-acf0-3039ab2af9e1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:32.171359 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0a062984-4557-4502-acf0-3039ab2af9e1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.538756 Aug 26 15:50:32.172945 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0d6d1fe4-3c6c-4f71-b74e-08f769da30f2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:32.174037 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 41/80] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:31 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:32.174460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0d6d1fe4-3c6c-4f71-b74e-08f769da30f2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:32.174460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d6d1fe4-3c6c-4f71-b74e-08f769da30f2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:32.174460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d6d1fe4-3c6c-4f71-b74e-08f769da30f2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:32.174460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d6d1fe4-3c6c-4f71-b74e-08f769da30f2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:32.175265 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d6d1fe4-3c6c-4f71-b74e-08f769da30f2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:32.175265 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d6d1fe4-3c6c-4f71-b74e-08f769da30f2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:32.175265 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d6d1fe4-3c6c-4f71-b74e-08f769da30f2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:32.175575 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-6f6148c3-ec75-49f8-8381-cce492d8c1d2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:32.175575 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-6f6148c3-ec75-49f8-8381-cce492d8c1d2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:32.175575 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6f6148c3-ec75-49f8-8381-cce492d8c1d2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:32.175575 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6f6148c3-ec75-49f8-8381-cce492d8c1d2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:32.176212 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6f6148c3-ec75-49f8-8381-cce492d8c1d2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:32.176386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6f6148c3-ec75-49f8-8381-cce492d8c1d2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:32.177357 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6f6148c3-ec75-49f8-8381-cce492d8c1d2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:32.177357 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6f6148c3-ec75-49f8-8381-cce492d8c1d2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:32.450434 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-6f6148c3-ec75-49f8-8381-cce492d8c1d2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:32.459986 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-6f6148c3-ec75-49f8-8381-cce492d8c1d2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.302619 Aug 26 15:50:32.485192 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 42/81] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:32 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:32.517245 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0d6d1fe4-3c6c-4f71-b74e-08f769da30f2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:32.525283 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0d6d1fe4-3c6c-4f71-b74e-08f769da30f2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.414539 Aug 26 15:50:32.527937 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 40/82] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:32 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:32.798874 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=24 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:32.897640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-c443d9df-5e01-4987-9c01-5589ae902b52 req-adba8d36-8da0-4ac1-a216-10779702c39a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bdeefc3-4622-43da-a414-d7813721bc01", "tag": "35e38d0a-ebb0-4877-bfe3-31b8806f3fde"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:32.934809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-c443d9df-5e01-4987-9c01-5589ae902b52 req-adba8d36-8da0-4ac1-a216-10779702c39a service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:32.935611 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-c443d9df-5e01-4987-9c01-5589ae902b52 req-adba8d36-8da0-4ac1-a216-10779702c39a service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:32.938894 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-c443d9df-5e01-4987-9c01-5589ae902b52 req-adba8d36-8da0-4ac1-a216-10779702c39a service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:33.031538 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-c443d9df-5e01-4987-9c01-5589ae902b52 req-adba8d36-8da0-4ac1-a216-10779702c39a service nova] Creating event network-changed:35e38d0a-ebb0-4877-bfe3-31b8806f3fde for instance 6bdeefc3-4622-43da-a414-d7813721bc01 on hv-cinder-83124 Aug 26 15:50:33.031538 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-c443d9df-5e01-4987-9c01-5589ae902b52 req-adba8d36-8da0-4ac1-a216-10779702c39a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 15:50:33.031538 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-c443d9df-5e01-4987-9c01-5589ae902b52 req-adba8d36-8da0-4ac1-a216-10779702c39a service nova] Acquired lock "compute-rpcapi-router" {{(pid=127698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 15:50:33.031538 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-816be98b-a22d-453b-a42f-5a972c9c8618 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:33.031538 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-816be98b-a22d-453b-a42f-5a972c9c8618 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:33.032696 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-816be98b-a22d-453b-a42f-5a972c9c8618 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:33.032696 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-816be98b-a22d-453b-a42f-5a972c9c8618 None None] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:33.032696 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-816be98b-a22d-453b-a42f-5a972c9c8618 None None] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:33.032696 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-816be98b-a22d-453b-a42f-5a972c9c8618 None None] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:33.032696 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.compute.rpcapi [None req-816be98b-a22d-453b-a42f-5a972c9c8618 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 15:50:33.033375 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-816be98b-a22d-453b-a42f-5a972c9c8618 None None] Releasing lock "compute-rpcapi-router" {{(pid=127698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 15:50:33.033375 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-816be98b-a22d-453b-a42f-5a972c9c8618 None None] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.324066 Aug 26 15:50:33.033375 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 43/83] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:33.178274 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-24fffb45-69f9-4b97-8f7d-1946de609852 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:33.179055 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-24fffb45-69f9-4b97-8f7d-1946de609852 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:33.182438 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=24 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:33.187236 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-24fffb45-69f9-4b97-8f7d-1946de609852 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:33.187726 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-24fffb45-69f9-4b97-8f7d-1946de609852 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:33.188483 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-24fffb45-69f9-4b97-8f7d-1946de609852 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:33.189253 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-24fffb45-69f9-4b97-8f7d-1946de609852 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:33.189717 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-24fffb45-69f9-4b97-8f7d-1946de609852 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:33.190391 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-24fffb45-69f9-4b97-8f7d-1946de609852 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:33.437725 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-24fffb45-69f9-4b97-8f7d-1946de609852 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:33.446511 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-24fffb45-69f9-4b97-8f7d-1946de609852 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.272170 Aug 26 15:50:33.460506 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 41/84] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:33 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:33.493955 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f2b110d7-26b5-443a-9ba6-7d7c2bff7cf0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:33.507860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f2b110d7-26b5-443a-9ba6-7d7c2bff7cf0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:33.507860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:33.507860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2b110d7-26b5-443a-9ba6-7d7c2bff7cf0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:33.507860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2b110d7-26b5-443a-9ba6-7d7c2bff7cf0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:33.510008 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2b110d7-26b5-443a-9ba6-7d7c2bff7cf0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:33.510008 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2b110d7-26b5-443a-9ba6-7d7c2bff7cf0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:33.510008 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2b110d7-26b5-443a-9ba6-7d7c2bff7cf0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:33.510008 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2b110d7-26b5-443a-9ba6-7d7c2bff7cf0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:33.562652 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b8442ec2-ea93-4b63-86ae-b251fb78abcb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:33.563574 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b8442ec2-ea93-4b63-86ae-b251fb78abcb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:33.614326 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b8442ec2-ea93-4b63-86ae-b251fb78abcb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:33.619221 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b8442ec2-ea93-4b63-86ae-b251fb78abcb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:33.621175 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b8442ec2-ea93-4b63-86ae-b251fb78abcb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:33.622319 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b8442ec2-ea93-4b63-86ae-b251fb78abcb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:33.623794 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b8442ec2-ea93-4b63-86ae-b251fb78abcb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:33.624418 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b8442ec2-ea93-4b63-86ae-b251fb78abcb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:33.958439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f2b110d7-26b5-443a-9ba6-7d7c2bff7cf0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:33.969064 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f2b110d7-26b5-443a-9ba6-7d7c2bff7cf0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.483799 Aug 26 15:50:33.972685 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 44/85] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:33 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:34.044178 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b8442ec2-ea93-4b63-86ae-b251fb78abcb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:34.060522 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b8442ec2-ea93-4b63-86ae-b251fb78abcb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.515475 Aug 26 15:50:34.062668 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 42/86] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:33 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:34.469017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ec1b7443-ba71-41c4-98da-f7915a2edd03 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:34.469017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ec1b7443-ba71-41c4-98da-f7915a2edd03 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:34.494351 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ec1b7443-ba71-41c4-98da-f7915a2edd03 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:34.495259 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ec1b7443-ba71-41c4-98da-f7915a2edd03 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:34.496070 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ec1b7443-ba71-41c4-98da-f7915a2edd03 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:34.497017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ec1b7443-ba71-41c4-98da-f7915a2edd03 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:34.498186 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ec1b7443-ba71-41c4-98da-f7915a2edd03 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:34.501179 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ec1b7443-ba71-41c4-98da-f7915a2edd03 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:34.811528 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ec1b7443-ba71-41c4-98da-f7915a2edd03 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:34.829645 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ec1b7443-ba71-41c4-98da-f7915a2edd03 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.356978 Aug 26 15:50:34.835107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 45/87] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:34 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:34.999479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-41c99cc8-3252-40ff-b095-491c1becab11 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:35.000200 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-41c99cc8-3252-40ff-b095-491c1becab11 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:35.008068 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41c99cc8-3252-40ff-b095-491c1becab11 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:35.009022 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41c99cc8-3252-40ff-b095-491c1becab11 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:35.009467 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41c99cc8-3252-40ff-b095-491c1becab11 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:35.010210 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41c99cc8-3252-40ff-b095-491c1becab11 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:35.010659 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41c99cc8-3252-40ff-b095-491c1becab11 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:35.011116 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41c99cc8-3252-40ff-b095-491c1becab11 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:35.170753 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-07671f5d-2e04-4d01-b77c-4c1b650ded62 req-51c445e3-251e-43c1-a22c-033a00b0b1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d429ff90-f8c3-47df-8bde-884a597251d6", "tag": "c56e18a2-a1c2-4bab-afa7-6e0bbf18ac6c"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:35.199102 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-41c99cc8-3252-40ff-b095-491c1becab11 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:35.206990 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-07671f5d-2e04-4d01-b77c-4c1b650ded62 req-51c445e3-251e-43c1-a22c-033a00b0b1b2 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:35.211895 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-41c99cc8-3252-40ff-b095-491c1becab11 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.216535 Aug 26 15:50:35.212140 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 46/88] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:34 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:35.229890 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-07671f5d-2e04-4d01-b77c-4c1b650ded62 req-51c445e3-251e-43c1-a22c-033a00b0b1b2 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:35.230657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-07671f5d-2e04-4d01-b77c-4c1b650ded62 req-51c445e3-251e-43c1-a22c-033a00b0b1b2 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:35.235061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-132c71a8-85c2-44c8-b645-1b8bc8d21073 req-319572d7-33a5-4dc3-8f38-49973e1b46bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae5c9c4-de22-4f03-a66b-3b0a632131e0", "tag": "57ccb93e-3e0c-4959-a846-0f9b661425bf"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:35.255567 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-132c71a8-85c2-44c8-b645-1b8bc8d21073 req-319572d7-33a5-4dc3-8f38-49973e1b46bf service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:35.261967 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-132c71a8-85c2-44c8-b645-1b8bc8d21073 req-319572d7-33a5-4dc3-8f38-49973e1b46bf service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:35.262636 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-132c71a8-85c2-44c8-b645-1b8bc8d21073 req-319572d7-33a5-4dc3-8f38-49973e1b46bf service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:35.270212 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-07671f5d-2e04-4d01-b77c-4c1b650ded62 req-51c445e3-251e-43c1-a22c-033a00b0b1b2 service nova] Creating event network-changed:c56e18a2-a1c2-4bab-afa7-6e0bbf18ac6c for instance d429ff90-f8c3-47df-8bde-884a597251d6 on hv-cinder-83124 Aug 26 15:50:35.276652 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-07671f5d-2e04-4d01-b77c-4c1b650ded62 req-51c445e3-251e-43c1-a22c-033a00b0b1b2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 15:50:35.277262 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-07671f5d-2e04-4d01-b77c-4c1b650ded62 req-51c445e3-251e-43c1-a22c-033a00b0b1b2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 15:50:35.278512 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5241d90f-9181-4bc2-9356-113f3c0c04d8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:35.279384 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5241d90f-9181-4bc2-9356-113f3c0c04d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:35.280023 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5241d90f-9181-4bc2-9356-113f3c0c04d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:35.280914 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5241d90f-9181-4bc2-9356-113f3c0c04d8 None None] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:35.283068 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-132c71a8-85c2-44c8-b645-1b8bc8d21073 req-319572d7-33a5-4dc3-8f38-49973e1b46bf service nova] Creating event network-changed:57ccb93e-3e0c-4959-a846-0f9b661425bf for instance eae5c9c4-de22-4f03-a66b-3b0a632131e0 on hv-cinder-83124 Aug 26 15:50:35.283731 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5241d90f-9181-4bc2-9356-113f3c0c04d8 None None] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:35.284229 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5241d90f-9181-4bc2-9356-113f3c0c04d8 None None] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:35.292802 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-132c71a8-85c2-44c8-b645-1b8bc8d21073 req-319572d7-33a5-4dc3-8f38-49973e1b46bf service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065476 Aug 26 15:50:35.292802 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 47/89] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:35.300094 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.compute.rpcapi [None req-5241d90f-9181-4bc2-9356-113f3c0c04d8 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 15:50:35.300297 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-90c06428-1193-40b6-9d43-f01b247b960b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:35.300668 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5241d90f-9181-4bc2-9356-113f3c0c04d8 None None] Releasing lock "compute-rpcapi-router" {{(pid=127697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 15:50:35.300975 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-90c06428-1193-40b6-9d43-f01b247b960b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:35.309118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-90c06428-1193-40b6-9d43-f01b247b960b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:35.310828 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-90c06428-1193-40b6-9d43-f01b247b960b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:35.311220 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-90c06428-1193-40b6-9d43-f01b247b960b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:35.312270 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-90c06428-1193-40b6-9d43-f01b247b960b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:35.312691 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-90c06428-1193-40b6-9d43-f01b247b960b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:35.313192 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-90c06428-1193-40b6-9d43-f01b247b960b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:35.334486 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5241d90f-9181-4bc2-9356-113f3c0c04d8 None None] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.605873 Aug 26 15:50:35.337372 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 43/90] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:35.528852 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-90c06428-1193-40b6-9d43-f01b247b960b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:35.536045 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=100 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:35.538753 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-90c06428-1193-40b6-9d43-f01b247b960b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.245072 Aug 26 15:50:35.554102 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 48/91] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:35 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:35.847194 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7c0ad984-eb42-4d9a-ba85-bf5886aa5cb7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:35.851606 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7c0ad984-eb42-4d9a-ba85-bf5886aa5cb7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:35.857586 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7c0ad984-eb42-4d9a-ba85-bf5886aa5cb7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:35.858277 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7c0ad984-eb42-4d9a-ba85-bf5886aa5cb7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:35.858735 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7c0ad984-eb42-4d9a-ba85-bf5886aa5cb7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:35.859624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7c0ad984-eb42-4d9a-ba85-bf5886aa5cb7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:35.860108 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7c0ad984-eb42-4d9a-ba85-bf5886aa5cb7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:35.860528 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7c0ad984-eb42-4d9a-ba85-bf5886aa5cb7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:36.031800 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7c0ad984-eb42-4d9a-ba85-bf5886aa5cb7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:36.045034 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7c0ad984-eb42-4d9a-ba85-bf5886aa5cb7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.205905 Aug 26 15:50:36.051996 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 44/92] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:35 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:36.238386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f5ab1462-f069-42de-857a-d77b0d84b949 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:36.239170 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f5ab1462-f069-42de-857a-d77b0d84b949 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:36.258199 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f5ab1462-f069-42de-857a-d77b0d84b949 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:36.258882 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f5ab1462-f069-42de-857a-d77b0d84b949 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:36.259411 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f5ab1462-f069-42de-857a-d77b0d84b949 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:36.260258 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f5ab1462-f069-42de-857a-d77b0d84b949 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:36.260793 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f5ab1462-f069-42de-857a-d77b0d84b949 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:36.261271 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f5ab1462-f069-42de-857a-d77b0d84b949 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:36.465441 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f5ab1462-f069-42de-857a-d77b0d84b949 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:36.478163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f5ab1462-f069-42de-857a-d77b0d84b949 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.245182 Aug 26 15:50:36.479233 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 49/93] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:36 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:36.571168 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-aa8b50f2-33b3-4e31-9476-b85c7d9851bc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:36.571889 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-aa8b50f2-33b3-4e31-9476-b85c7d9851bc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:36.578570 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aa8b50f2-33b3-4e31-9476-b85c7d9851bc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:36.579287 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aa8b50f2-33b3-4e31-9476-b85c7d9851bc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:36.579902 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aa8b50f2-33b3-4e31-9476-b85c7d9851bc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:36.580945 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aa8b50f2-33b3-4e31-9476-b85c7d9851bc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:36.581545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aa8b50f2-33b3-4e31-9476-b85c7d9851bc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:36.584342 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aa8b50f2-33b3-4e31-9476-b85c7d9851bc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:36.749962 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-aa8b50f2-33b3-4e31-9476-b85c7d9851bc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:36.757804 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-aa8b50f2-33b3-4e31-9476-b85c7d9851bc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.201617 Aug 26 15:50:36.758385 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 45/94] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:36 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:37.068633 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5dc35243-117d-418e-ac48-fc3802272c86 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:37.070465 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5dc35243-117d-418e-ac48-fc3802272c86 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:37.084848 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5dc35243-117d-418e-ac48-fc3802272c86 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:37.085961 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5dc35243-117d-418e-ac48-fc3802272c86 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:37.086636 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5dc35243-117d-418e-ac48-fc3802272c86 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:37.087776 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5dc35243-117d-418e-ac48-fc3802272c86 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:37.088651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5dc35243-117d-418e-ac48-fc3802272c86 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:37.089190 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5dc35243-117d-418e-ac48-fc3802272c86 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:37.366302 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-5dc35243-117d-418e-ac48-fc3802272c86 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:37.430740 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5dc35243-117d-418e-ac48-fc3802272c86 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.368004 Aug 26 15:50:37.443120 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-be4f8d18-06ae-4143-94a1-eb17e69bb0cb req-18b6b01f-ca6d-4b0b-b960-bf41aa0166a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff835f8-1f60-42e7-b12f-bb08724decc6", "tag": "4b02b745-e421-4c5a-bf2a-85638bcc6243"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:37.443794 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 50/95] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:37 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:37.452314 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-be4f8d18-06ae-4143-94a1-eb17e69bb0cb req-18b6b01f-ca6d-4b0b-b960-bf41aa0166a3 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:37.453536 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-be4f8d18-06ae-4143-94a1-eb17e69bb0cb req-18b6b01f-ca6d-4b0b-b960-bf41aa0166a3 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:37.454474 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-be4f8d18-06ae-4143-94a1-eb17e69bb0cb req-18b6b01f-ca6d-4b0b-b960-bf41aa0166a3 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:37.479404 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-be4f8d18-06ae-4143-94a1-eb17e69bb0cb req-18b6b01f-ca6d-4b0b-b960-bf41aa0166a3 service nova] Creating event network-changed:4b02b745-e421-4c5a-bf2a-85638bcc6243 for instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 on hv-cinder-83124 Aug 26 15:50:37.489169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-be4f8d18-06ae-4143-94a1-eb17e69bb0cb req-18b6b01f-ca6d-4b0b-b960-bf41aa0166a3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074449 Aug 26 15:50:37.490757 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 46/96] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:37.504853 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2fc52b9a-e59d-4f7e-ad91-1ab9e598e6a6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:37.505689 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2fc52b9a-e59d-4f7e-ad91-1ab9e598e6a6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:37.528696 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2fc52b9a-e59d-4f7e-ad91-1ab9e598e6a6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:37.529355 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2fc52b9a-e59d-4f7e-ad91-1ab9e598e6a6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:37.531459 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2fc52b9a-e59d-4f7e-ad91-1ab9e598e6a6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:37.532235 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2fc52b9a-e59d-4f7e-ad91-1ab9e598e6a6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:37.534714 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2fc52b9a-e59d-4f7e-ad91-1ab9e598e6a6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:37.534714 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2fc52b9a-e59d-4f7e-ad91-1ab9e598e6a6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:37.939303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c79e1089-9f04-4f73-b454-c0aa4e1466c9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:37.939303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c79e1089-9f04-4f73-b454-c0aa4e1466c9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:37.939303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c79e1089-9f04-4f73-b454-c0aa4e1466c9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:37.939303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c79e1089-9f04-4f73-b454-c0aa4e1466c9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:37.940432 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c79e1089-9f04-4f73-b454-c0aa4e1466c9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:37.940432 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c79e1089-9f04-4f73-b454-c0aa4e1466c9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:37.940432 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c79e1089-9f04-4f73-b454-c0aa4e1466c9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:37.940432 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c79e1089-9f04-4f73-b454-c0aa4e1466c9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:38.073178 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c79e1089-9f04-4f73-b454-c0aa4e1466c9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:38.081750 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=100 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:38.085211 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c79e1089-9f04-4f73-b454-c0aa4e1466c9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.307147 Aug 26 15:50:38.086671 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 47/97] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:37 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:38.194510 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2fc52b9a-e59d-4f7e-ad91-1ab9e598e6a6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:38.203620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2fc52b9a-e59d-4f7e-ad91-1ab9e598e6a6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.702947 Aug 26 15:50:38.204491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 51/98] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:37 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:38.479683 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5128f783-d63a-433a-bf45-63893efdf4e2 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:38.479683 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5128f783-d63a-433a-bf45-63893efdf4e2 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:38.484308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5128f783-d63a-433a-bf45-63893efdf4e2 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:38.484936 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5128f783-d63a-433a-bf45-63893efdf4e2 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:38.485449 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5128f783-d63a-433a-bf45-63893efdf4e2 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:38.492576 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5128f783-d63a-433a-bf45-63893efdf4e2 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:38.493174 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5128f783-d63a-433a-bf45-63893efdf4e2 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:38.495556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5128f783-d63a-433a-bf45-63893efdf4e2 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:38.758050 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5128f783-d63a-433a-bf45-63893efdf4e2 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:38.777359 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5128f783-d63a-433a-bf45-63893efdf4e2 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.316935 Aug 26 15:50:38.792203 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 48/99] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:38 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:39.109315 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-513e1184-de6e-4b8c-ac94-505445c782b8 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:39.110078 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-513e1184-de6e-4b8c-ac94-505445c782b8 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:39.118057 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-513e1184-de6e-4b8c-ac94-505445c782b8 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:39.118934 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-513e1184-de6e-4b8c-ac94-505445c782b8 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:39.119590 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-513e1184-de6e-4b8c-ac94-505445c782b8 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:39.120620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-513e1184-de6e-4b8c-ac94-505445c782b8 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:39.121224 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-513e1184-de6e-4b8c-ac94-505445c782b8 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:39.121848 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-513e1184-de6e-4b8c-ac94-505445c782b8 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:39.225806 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-61e3362a-a826-4d59-94e3-fd661001a0d3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:39.226505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-61e3362a-a826-4d59-94e3-fd661001a0d3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:39.233754 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-61e3362a-a826-4d59-94e3-fd661001a0d3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:39.234354 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-61e3362a-a826-4d59-94e3-fd661001a0d3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:39.234862 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-61e3362a-a826-4d59-94e3-fd661001a0d3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:39.235635 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-61e3362a-a826-4d59-94e3-fd661001a0d3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:39.236188 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-61e3362a-a826-4d59-94e3-fd661001a0d3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:39.236754 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-61e3362a-a826-4d59-94e3-fd661001a0d3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:39.330828 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-513e1184-de6e-4b8c-ac94-505445c782b8 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:39.339174 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-513e1184-de6e-4b8c-ac94-505445c782b8 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.234864 Aug 26 15:50:39.339760 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 52/100] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:39 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:39.529105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-61e3362a-a826-4d59-94e3-fd661001a0d3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:39.536862 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-61e3362a-a826-4d59-94e3-fd661001a0d3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.314990 Aug 26 15:50:39.537440 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 49/101] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:39 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:39.811434 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e47999cb-2b84-4b10-85ad-1cedb6e5b87d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:39.812096 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e47999cb-2b84-4b10-85ad-1cedb6e5b87d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:39.818727 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e47999cb-2b84-4b10-85ad-1cedb6e5b87d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:39.819220 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e47999cb-2b84-4b10-85ad-1cedb6e5b87d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:39.819664 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e47999cb-2b84-4b10-85ad-1cedb6e5b87d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:39.820395 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e47999cb-2b84-4b10-85ad-1cedb6e5b87d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:39.822051 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e47999cb-2b84-4b10-85ad-1cedb6e5b87d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:39.822652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e47999cb-2b84-4b10-85ad-1cedb6e5b87d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:40.005890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e47999cb-2b84-4b10-85ad-1cedb6e5b87d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:40.014641 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e47999cb-2b84-4b10-85ad-1cedb6e5b87d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.208338 Aug 26 15:50:40.015590 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 53/102] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:39 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:40.360865 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-14fd8a54-e1db-4df4-afd5-66d9bf072d18 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:40.364536 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-14fd8a54-e1db-4df4-afd5-66d9bf072d18 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:40.367481 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-14fd8a54-e1db-4df4-afd5-66d9bf072d18 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:40.368000 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-14fd8a54-e1db-4df4-afd5-66d9bf072d18 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:40.368440 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-14fd8a54-e1db-4df4-afd5-66d9bf072d18 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:40.369133 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-14fd8a54-e1db-4df4-afd5-66d9bf072d18 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:40.369588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-14fd8a54-e1db-4df4-afd5-66d9bf072d18 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:40.370015 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-14fd8a54-e1db-4df4-afd5-66d9bf072d18 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:40.517658 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-14fd8a54-e1db-4df4-afd5-66d9bf072d18 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:40.527045 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-14fd8a54-e1db-4df4-afd5-66d9bf072d18 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.169713 Aug 26 15:50:40.532571 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 50/103] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:40 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:40.558668 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-67c3c304-2cdb-4ebf-9c41-cfebe1b44056 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:40.559295 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-67c3c304-2cdb-4ebf-9c41-cfebe1b44056 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:40.567043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-67c3c304-2cdb-4ebf-9c41-cfebe1b44056 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:40.567665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-67c3c304-2cdb-4ebf-9c41-cfebe1b44056 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:40.568294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-67c3c304-2cdb-4ebf-9c41-cfebe1b44056 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:40.569219 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-67c3c304-2cdb-4ebf-9c41-cfebe1b44056 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:40.569975 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-67c3c304-2cdb-4ebf-9c41-cfebe1b44056 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:40.570474 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-67c3c304-2cdb-4ebf-9c41-cfebe1b44056 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:40.757762 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-67c3c304-2cdb-4ebf-9c41-cfebe1b44056 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:40.765938 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-67c3c304-2cdb-4ebf-9c41-cfebe1b44056 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.211683 Aug 26 15:50:40.766466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 54/104] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:40 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:41.037745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-cbb55ad3-cbc7-483b-b3a0-261695de0bc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:41.038683 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-cbb55ad3-cbc7-483b-b3a0-261695de0bc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:41.045748 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cbb55ad3-cbc7-483b-b3a0-261695de0bc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:41.046552 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cbb55ad3-cbc7-483b-b3a0-261695de0bc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:41.047095 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cbb55ad3-cbc7-483b-b3a0-261695de0bc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:41.048116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cbb55ad3-cbc7-483b-b3a0-261695de0bc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:41.048761 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cbb55ad3-cbc7-483b-b3a0-261695de0bc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:41.049346 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cbb55ad3-cbc7-483b-b3a0-261695de0bc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:41.195749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cbb55ad3-cbc7-483b-b3a0-261695de0bc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:41.216192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-cbb55ad3-cbc7-483b-b3a0-261695de0bc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.171574 Aug 26 15:50:41.217787 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 51/105] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:41 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:41.550862 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7b9b17e8-27aa-469d-9afb-3dd7b5950137 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:41.551552 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7b9b17e8-27aa-469d-9afb-3dd7b5950137 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:41.557485 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b9b17e8-27aa-469d-9afb-3dd7b5950137 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:41.557968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b9b17e8-27aa-469d-9afb-3dd7b5950137 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:41.558653 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b9b17e8-27aa-469d-9afb-3dd7b5950137 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:41.559971 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b9b17e8-27aa-469d-9afb-3dd7b5950137 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:41.560521 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b9b17e8-27aa-469d-9afb-3dd7b5950137 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:41.560877 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b9b17e8-27aa-469d-9afb-3dd7b5950137 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:41.754828 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7b9b17e8-27aa-469d-9afb-3dd7b5950137 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:41.769799 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7b9b17e8-27aa-469d-9afb-3dd7b5950137 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.221444 Aug 26 15:50:41.784106 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 55/106] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:41 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:41.786050 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9fd4d68d-db47-429f-bb00-6037332ef1b0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:41.786655 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9fd4d68d-db47-429f-bb00-6037332ef1b0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:41.789608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:41.803337 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9fd4d68d-db47-429f-bb00-6037332ef1b0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:41.803833 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9fd4d68d-db47-429f-bb00-6037332ef1b0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:41.804426 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9fd4d68d-db47-429f-bb00-6037332ef1b0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:41.805008 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9fd4d68d-db47-429f-bb00-6037332ef1b0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:41.805459 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9fd4d68d-db47-429f-bb00-6037332ef1b0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:41.805897 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9fd4d68d-db47-429f-bb00-6037332ef1b0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:41.941816 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9fd4d68d-db47-429f-bb00-6037332ef1b0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:41.949499 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9fd4d68d-db47-429f-bb00-6037332ef1b0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.167263 Aug 26 15:50:41.950064 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 52/107] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:41 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:42.237361 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d1ffe3de-c18a-4f58-963a-2e750848d5d9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:42.237984 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d1ffe3de-c18a-4f58-963a-2e750848d5d9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:42.244120 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d1ffe3de-c18a-4f58-963a-2e750848d5d9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:42.244600 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d1ffe3de-c18a-4f58-963a-2e750848d5d9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:42.245217 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d1ffe3de-c18a-4f58-963a-2e750848d5d9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:42.245911 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d1ffe3de-c18a-4f58-963a-2e750848d5d9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:42.246363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d1ffe3de-c18a-4f58-963a-2e750848d5d9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:42.250392 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d1ffe3de-c18a-4f58-963a-2e750848d5d9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:42.399798 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d1ffe3de-c18a-4f58-963a-2e750848d5d9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:42.407494 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d1ffe3de-c18a-4f58-963a-2e750848d5d9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.173961 Aug 26 15:50:42.408066 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 56/108] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:42 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:42.790474 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-4a087843-fd81-44c5-9804-ce384df542fc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:42.791090 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-4a087843-fd81-44c5-9804-ce384df542fc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:42.797072 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4a087843-fd81-44c5-9804-ce384df542fc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:42.797562 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4a087843-fd81-44c5-9804-ce384df542fc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:42.798549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4a087843-fd81-44c5-9804-ce384df542fc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:42.799312 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4a087843-fd81-44c5-9804-ce384df542fc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:42.799802 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4a087843-fd81-44c5-9804-ce384df542fc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:42.800259 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4a087843-fd81-44c5-9804-ce384df542fc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:42.948865 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-4a087843-fd81-44c5-9804-ce384df542fc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:42.968546 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-4a087843-fd81-44c5-9804-ce384df542fc tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.170338 Aug 26 15:50:42.968546 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 53/109] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:42 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:42.971053 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-6609ed79-d207-477c-b9c8-e7971b4e39d0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:42.971657 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-6609ed79-d207-477c-b9c8-e7971b4e39d0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:42.977571 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6609ed79-d207-477c-b9c8-e7971b4e39d0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:42.978043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6609ed79-d207-477c-b9c8-e7971b4e39d0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:42.978479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6609ed79-d207-477c-b9c8-e7971b4e39d0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:42.979189 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6609ed79-d207-477c-b9c8-e7971b4e39d0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:42.979631 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6609ed79-d207-477c-b9c8-e7971b4e39d0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:42.980075 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6609ed79-d207-477c-b9c8-e7971b4e39d0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:43.170368 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-6609ed79-d207-477c-b9c8-e7971b4e39d0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:43.177932 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-6609ed79-d207-477c-b9c8-e7971b4e39d0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.210716 Aug 26 15:50:43.178508 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 57/110] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:42 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:43.428492 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-55dfccbc-ac46-4670-b202-512d0e39ce9b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:43.429491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-55dfccbc-ac46-4670-b202-512d0e39ce9b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:43.438654 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-55dfccbc-ac46-4670-b202-512d0e39ce9b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:43.439666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-55dfccbc-ac46-4670-b202-512d0e39ce9b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:43.440369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-55dfccbc-ac46-4670-b202-512d0e39ce9b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:43.441506 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-55dfccbc-ac46-4670-b202-512d0e39ce9b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:43.442222 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-55dfccbc-ac46-4670-b202-512d0e39ce9b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:43.442879 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-55dfccbc-ac46-4670-b202-512d0e39ce9b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:43.583455 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-55dfccbc-ac46-4670-b202-512d0e39ce9b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:43.591754 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-55dfccbc-ac46-4670-b202-512d0e39ce9b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.167863 Aug 26 15:50:43.592574 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 54/111] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:43 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:43.979139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c27c4e46-5ee5-4419-abd5-57ace2b7a44d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:43.979661 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c27c4e46-5ee5-4419-abd5-57ace2b7a44d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:43.987107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c27c4e46-5ee5-4419-abd5-57ace2b7a44d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:43.987597 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c27c4e46-5ee5-4419-abd5-57ace2b7a44d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:43.988095 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c27c4e46-5ee5-4419-abd5-57ace2b7a44d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:43.988954 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c27c4e46-5ee5-4419-abd5-57ace2b7a44d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:43.989407 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c27c4e46-5ee5-4419-abd5-57ace2b7a44d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:43.989829 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c27c4e46-5ee5-4419-abd5-57ace2b7a44d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:44.182249 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c27c4e46-5ee5-4419-abd5-57ace2b7a44d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:44.191110 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c27c4e46-5ee5-4419-abd5-57ace2b7a44d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.215886 Aug 26 15:50:44.192251 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 58/112] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:43 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:44.200118 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-214c7966-2cb5-4abf-98e9-132ed24454d5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:44.201965 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-214c7966-2cb5-4abf-98e9-132ed24454d5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:44.222338 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-214c7966-2cb5-4abf-98e9-132ed24454d5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:44.223085 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-214c7966-2cb5-4abf-98e9-132ed24454d5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:44.223739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-214c7966-2cb5-4abf-98e9-132ed24454d5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:44.225284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-214c7966-2cb5-4abf-98e9-132ed24454d5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:44.226197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-214c7966-2cb5-4abf-98e9-132ed24454d5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:44.226897 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-214c7966-2cb5-4abf-98e9-132ed24454d5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:44.613148 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-469dac16-3559-4400-879d-d5baab056e8b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:44.614347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-469dac16-3559-4400-879d-d5baab056e8b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:44.621849 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-469dac16-3559-4400-879d-d5baab056e8b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:44.623027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-469dac16-3559-4400-879d-d5baab056e8b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:44.626063 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-469dac16-3559-4400-879d-d5baab056e8b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:44.627034 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-469dac16-3559-4400-879d-d5baab056e8b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:44.627882 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-469dac16-3559-4400-879d-d5baab056e8b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:44.628486 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-469dac16-3559-4400-879d-d5baab056e8b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:45.027006 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-214c7966-2cb5-4abf-98e9-132ed24454d5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:45.027006 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-214c7966-2cb5-4abf-98e9-132ed24454d5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.572248 Aug 26 15:50:45.027006 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 55/113] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:44 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:45.155292 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-469dac16-3559-4400-879d-d5baab056e8b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:45.165109 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-469dac16-3559-4400-879d-d5baab056e8b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.556010 Aug 26 15:50:45.173002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 59/114] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:44 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:45.218379 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-4f7a2ac2-c93f-4850-bcdc-54d84891f8d9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:45.225938 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-4f7a2ac2-c93f-4850-bcdc-54d84891f8d9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:45.230920 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4f7a2ac2-c93f-4850-bcdc-54d84891f8d9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:45.233617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4f7a2ac2-c93f-4850-bcdc-54d84891f8d9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:45.234314 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4f7a2ac2-c93f-4850-bcdc-54d84891f8d9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:45.236096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4f7a2ac2-c93f-4850-bcdc-54d84891f8d9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:45.237625 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4f7a2ac2-c93f-4850-bcdc-54d84891f8d9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:45.238530 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4f7a2ac2-c93f-4850-bcdc-54d84891f8d9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:45.299379 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:45.563788 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-4f7a2ac2-c93f-4850-bcdc-54d84891f8d9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:45.573583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-4f7a2ac2-c93f-4850-bcdc-54d84891f8d9 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.359591 Aug 26 15:50:45.574547 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 56/115] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:45 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:46.053024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b14c1abc-8806-4240-8eca-4d552a15c5bc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:46.053024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b14c1abc-8806-4240-8eca-4d552a15c5bc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:46.061789 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b14c1abc-8806-4240-8eca-4d552a15c5bc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:46.062930 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b14c1abc-8806-4240-8eca-4d552a15c5bc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:46.063717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b14c1abc-8806-4240-8eca-4d552a15c5bc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:46.064682 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b14c1abc-8806-4240-8eca-4d552a15c5bc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:46.065351 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b14c1abc-8806-4240-8eca-4d552a15c5bc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:46.073668 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b14c1abc-8806-4240-8eca-4d552a15c5bc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:46.188090 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c20a8e77-fca2-4925-ab22-7c6353ca98ba tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:46.189263 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c20a8e77-fca2-4925-ab22-7c6353ca98ba tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:46.205231 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c20a8e77-fca2-4925-ab22-7c6353ca98ba tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:46.205231 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c20a8e77-fca2-4925-ab22-7c6353ca98ba tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:46.205231 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c20a8e77-fca2-4925-ab22-7c6353ca98ba tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:46.205231 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c20a8e77-fca2-4925-ab22-7c6353ca98ba tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:46.205680 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c20a8e77-fca2-4925-ab22-7c6353ca98ba tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:46.205680 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c20a8e77-fca2-4925-ab22-7c6353ca98ba tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:46.242763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:46.398374 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c20a8e77-fca2-4925-ab22-7c6353ca98ba tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:46.402865 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-b14c1abc-8806-4240-8eca-4d552a15c5bc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:46.413921 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-b14c1abc-8806-4240-8eca-4d552a15c5bc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.369935 Aug 26 15:50:46.416802 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c20a8e77-fca2-4925-ab22-7c6353ca98ba tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.234017 Aug 26 15:50:46.419344 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 57/116] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:46 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:46.440021 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 60/117] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:46 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:46.594699 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e905abc1-ecea-4cc8-b317-df83e3dac96c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:46.595787 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e905abc1-ecea-4cc8-b317-df83e3dac96c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:46.607516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e905abc1-ecea-4cc8-b317-df83e3dac96c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:46.608349 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e905abc1-ecea-4cc8-b317-df83e3dac96c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:46.616880 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e905abc1-ecea-4cc8-b317-df83e3dac96c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:46.619740 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e905abc1-ecea-4cc8-b317-df83e3dac96c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:46.620466 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e905abc1-ecea-4cc8-b317-df83e3dac96c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:46.621012 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e905abc1-ecea-4cc8-b317-df83e3dac96c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:46.824984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e905abc1-ecea-4cc8-b317-df83e3dac96c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:46.834451 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e905abc1-ecea-4cc8-b317-df83e3dac96c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.243434 Aug 26 15:50:46.835706 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 58/118] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:46 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:47.436381 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0be554e1-4380-4f9b-a8d5-6476817963ff tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:47.436993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0be554e1-4380-4f9b-a8d5-6476817963ff tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:47.442951 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0be554e1-4380-4f9b-a8d5-6476817963ff tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:47.443451 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0be554e1-4380-4f9b-a8d5-6476817963ff tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:47.443911 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0be554e1-4380-4f9b-a8d5-6476817963ff tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:47.444592 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0be554e1-4380-4f9b-a8d5-6476817963ff tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:47.445138 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0be554e1-4380-4f9b-a8d5-6476817963ff tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:47.445560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0be554e1-4380-4f9b-a8d5-6476817963ff tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:47.450304 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-459c03d2-fa77-47f9-a088-34bcab42db9c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:47.452033 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-459c03d2-fa77-47f9-a088-34bcab42db9c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:47.457597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-459c03d2-fa77-47f9-a088-34bcab42db9c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:47.458116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-459c03d2-fa77-47f9-a088-34bcab42db9c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:47.458531 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-459c03d2-fa77-47f9-a088-34bcab42db9c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:47.459377 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-459c03d2-fa77-47f9-a088-34bcab42db9c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:47.459832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-459c03d2-fa77-47f9-a088-34bcab42db9c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:47.460285 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-459c03d2-fa77-47f9-a088-34bcab42db9c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:47.591144 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0be554e1-4380-4f9b-a8d5-6476817963ff tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:47.602809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0be554e1-4380-4f9b-a8d5-6476817963ff tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.170367 Aug 26 15:50:47.604360 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 61/119] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:47 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:47.629252 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-459c03d2-fa77-47f9-a088-34bcab42db9c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:47.637137 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-459c03d2-fa77-47f9-a088-34bcab42db9c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.190822 Aug 26 15:50:47.637766 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 59/120] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:47 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:47.856197 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e5d00b49-d813-4e18-9b47-ddc55b32b713 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:47.856927 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e5d00b49-d813-4e18-9b47-ddc55b32b713 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:47.863514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e5d00b49-d813-4e18-9b47-ddc55b32b713 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:47.866955 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e5d00b49-d813-4e18-9b47-ddc55b32b713 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:47.866955 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e5d00b49-d813-4e18-9b47-ddc55b32b713 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:47.866955 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e5d00b49-d813-4e18-9b47-ddc55b32b713 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:47.866955 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e5d00b49-d813-4e18-9b47-ddc55b32b713 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:47.867301 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e5d00b49-d813-4e18-9b47-ddc55b32b713 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:48.034132 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e5d00b49-d813-4e18-9b47-ddc55b32b713 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:48.045422 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e5d00b49-d813-4e18-9b47-ddc55b32b713 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.193166 Aug 26 15:50:48.058939 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 62/121] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:47 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:48.624667 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-30996521-6189-4e26-ad15-a56f98898c34 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:48.625298 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-30996521-6189-4e26-ad15-a56f98898c34 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:48.631034 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-30996521-6189-4e26-ad15-a56f98898c34 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:48.631508 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-30996521-6189-4e26-ad15-a56f98898c34 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:48.631970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-30996521-6189-4e26-ad15-a56f98898c34 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:48.632652 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-30996521-6189-4e26-ad15-a56f98898c34 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:48.633096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-30996521-6189-4e26-ad15-a56f98898c34 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:48.633526 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-30996521-6189-4e26-ad15-a56f98898c34 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:48.657394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-76ca3bcf-365e-4448-90b7-ba08b61a0e46 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:48.658001 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-76ca3bcf-365e-4448-90b7-ba08b61a0e46 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:48.664170 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76ca3bcf-365e-4448-90b7-ba08b61a0e46 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:48.664648 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76ca3bcf-365e-4448-90b7-ba08b61a0e46 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:48.665077 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76ca3bcf-365e-4448-90b7-ba08b61a0e46 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:48.665760 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76ca3bcf-365e-4448-90b7-ba08b61a0e46 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:48.666205 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76ca3bcf-365e-4448-90b7-ba08b61a0e46 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:48.666681 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76ca3bcf-365e-4448-90b7-ba08b61a0e46 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:48.792531 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-30996521-6189-4e26-ad15-a56f98898c34 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:48.801523 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-30996521-6189-4e26-ad15-a56f98898c34 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.181322 Aug 26 15:50:48.809375 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 60/122] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:48 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:48.822866 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-76ca3bcf-365e-4448-90b7-ba08b61a0e46 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:48.831175 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-76ca3bcf-365e-4448-90b7-ba08b61a0e46 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.177432 Aug 26 15:50:48.831737 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 63/123] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:48 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:49.067255 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-26e73449-6482-4ff2-8fdc-eb47f0915ce6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:49.067887 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-26e73449-6482-4ff2-8fdc-eb47f0915ce6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:49.074047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-26e73449-6482-4ff2-8fdc-eb47f0915ce6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:49.074526 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-26e73449-6482-4ff2-8fdc-eb47f0915ce6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:49.074955 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-26e73449-6482-4ff2-8fdc-eb47f0915ce6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:49.075686 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-26e73449-6482-4ff2-8fdc-eb47f0915ce6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:49.076773 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-26e73449-6482-4ff2-8fdc-eb47f0915ce6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:49.077190 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-26e73449-6482-4ff2-8fdc-eb47f0915ce6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:49.389089 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-26e73449-6482-4ff2-8fdc-eb47f0915ce6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:49.397342 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-26e73449-6482-4ff2-8fdc-eb47f0915ce6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.333908 Aug 26 15:50:49.398268 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 61/124] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:49 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:49.822483 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-febead85-b385-43e7-9872-6a1657e8973d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:49.823093 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-febead85-b385-43e7-9872-6a1657e8973d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:49.829568 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-febead85-b385-43e7-9872-6a1657e8973d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:49.830410 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-febead85-b385-43e7-9872-6a1657e8973d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:49.830659 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-febead85-b385-43e7-9872-6a1657e8973d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:49.831135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-febead85-b385-43e7-9872-6a1657e8973d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:49.831587 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-febead85-b385-43e7-9872-6a1657e8973d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:49.832021 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-febead85-b385-43e7-9872-6a1657e8973d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:49.856033 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0a1c20dd-3e75-4639-8d57-6ec6895d8b17 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:49.856602 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0a1c20dd-3e75-4639-8d57-6ec6895d8b17 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:49.870039 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a1c20dd-3e75-4639-8d57-6ec6895d8b17 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:49.870529 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a1c20dd-3e75-4639-8d57-6ec6895d8b17 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:49.871115 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a1c20dd-3e75-4639-8d57-6ec6895d8b17 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:49.871981 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a1c20dd-3e75-4639-8d57-6ec6895d8b17 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:49.872432 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a1c20dd-3e75-4639-8d57-6ec6895d8b17 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:49.872849 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a1c20dd-3e75-4639-8d57-6ec6895d8b17 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:49.988758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-febead85-b385-43e7-9872-6a1657e8973d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:49.998074 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-febead85-b385-43e7-9872-6a1657e8973d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.179311 Aug 26 15:50:50.011891 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0a1c20dd-3e75-4639-8d57-6ec6895d8b17 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:50.012546 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 64/125] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:49 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:50.020307 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0a1c20dd-3e75-4639-8d57-6ec6895d8b17 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.168042 Aug 26 15:50:50.023977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 62/126] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:49 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:50.419726 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-99c6d263-352d-40af-b0a1-483e4819074c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:50.420223 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-99c6d263-352d-40af-b0a1-483e4819074c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:50.426652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-99c6d263-352d-40af-b0a1-483e4819074c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:50.427143 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-99c6d263-352d-40af-b0a1-483e4819074c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:50.427579 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-99c6d263-352d-40af-b0a1-483e4819074c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:50.428407 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-99c6d263-352d-40af-b0a1-483e4819074c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:50.428947 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-99c6d263-352d-40af-b0a1-483e4819074c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:50.429295 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-99c6d263-352d-40af-b0a1-483e4819074c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:50.448688 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=100 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:50.563553 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-99c6d263-352d-40af-b0a1-483e4819074c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:50.570948 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-99c6d263-352d-40af-b0a1-483e4819074c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.155545 Aug 26 15:50:50.571512 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 65/127] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:50 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:51.019295 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-06283c55-81e2-48aa-b16b-e76a67d478a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:51.019937 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-06283c55-81e2-48aa-b16b-e76a67d478a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:51.026130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06283c55-81e2-48aa-b16b-e76a67d478a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:51.026621 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06283c55-81e2-48aa-b16b-e76a67d478a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:51.027060 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06283c55-81e2-48aa-b16b-e76a67d478a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:51.027761 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06283c55-81e2-48aa-b16b-e76a67d478a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:51.028257 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06283c55-81e2-48aa-b16b-e76a67d478a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:51.028684 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06283c55-81e2-48aa-b16b-e76a67d478a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:51.041871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-931d8ea7-56c2-41f3-b1ea-de7b5f7e47a3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:51.042491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-931d8ea7-56c2-41f3-b1ea-de7b5f7e47a3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:51.050209 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-931d8ea7-56c2-41f3-b1ea-de7b5f7e47a3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:51.051939 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-931d8ea7-56c2-41f3-b1ea-de7b5f7e47a3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:51.051939 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-931d8ea7-56c2-41f3-b1ea-de7b5f7e47a3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:51.051939 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-931d8ea7-56c2-41f3-b1ea-de7b5f7e47a3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:51.052483 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-931d8ea7-56c2-41f3-b1ea-de7b5f7e47a3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:51.053174 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-931d8ea7-56c2-41f3-b1ea-de7b5f7e47a3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:51.227335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-931d8ea7-56c2-41f3-b1ea-de7b5f7e47a3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:51.231892 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-06283c55-81e2-48aa-b16b-e76a67d478a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:51.241912 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-06283c55-81e2-48aa-b16b-e76a67d478a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.226302 Aug 26 15:50:51.252583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 63/128] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:51 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:51.253203 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-931d8ea7-56c2-41f3-b1ea-de7b5f7e47a3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.199321 Aug 26 15:50:51.253203 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 66/129] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:51 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:51.600995 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-ce5d3806-c9f1-42f1-8254-c220299c6dd7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:51.602047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ce5d3806-c9f1-42f1-8254-c220299c6dd7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:51.612253 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ce5d3806-c9f1-42f1-8254-c220299c6dd7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:51.613060 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ce5d3806-c9f1-42f1-8254-c220299c6dd7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:51.613776 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ce5d3806-c9f1-42f1-8254-c220299c6dd7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:51.614918 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ce5d3806-c9f1-42f1-8254-c220299c6dd7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:51.615670 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ce5d3806-c9f1-42f1-8254-c220299c6dd7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:51.616430 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ce5d3806-c9f1-42f1-8254-c220299c6dd7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:51.637828 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=100 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:51.757530 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ce5d3806-c9f1-42f1-8254-c220299c6dd7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:51.765390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-ce5d3806-c9f1-42f1-8254-c220299c6dd7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.170967 Aug 26 15:50:51.765959 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 64/130] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:51 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:52.270698 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-056610f5-0879-49da-96f7-09d8cd33ff41 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:52.271315 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-056610f5-0879-49da-96f7-09d8cd33ff41 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:52.274324 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-449c47f5-b1b3-478d-b221-80aa9d3e4900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:52.274961 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-449c47f5-b1b3-478d-b221-80aa9d3e4900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:52.277719 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-056610f5-0879-49da-96f7-09d8cd33ff41 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:52.278279 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-056610f5-0879-49da-96f7-09d8cd33ff41 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:52.278719 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-056610f5-0879-49da-96f7-09d8cd33ff41 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:52.280103 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-056610f5-0879-49da-96f7-09d8cd33ff41 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:52.280614 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-056610f5-0879-49da-96f7-09d8cd33ff41 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:52.281046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-056610f5-0879-49da-96f7-09d8cd33ff41 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:52.281636 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-449c47f5-b1b3-478d-b221-80aa9d3e4900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:52.282119 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-449c47f5-b1b3-478d-b221-80aa9d3e4900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:52.282554 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-449c47f5-b1b3-478d-b221-80aa9d3e4900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:52.283258 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-449c47f5-b1b3-478d-b221-80aa9d3e4900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:52.283708 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-449c47f5-b1b3-478d-b221-80aa9d3e4900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:52.284164 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-449c47f5-b1b3-478d-b221-80aa9d3e4900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:52.421667 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-056610f5-0879-49da-96f7-09d8cd33ff41 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:52.429969 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-056610f5-0879-49da-96f7-09d8cd33ff41 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.163122 Aug 26 15:50:52.430643 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 67/131] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:52 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:52.434589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-449c47f5-b1b3-478d-b221-80aa9d3e4900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:52.442758 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-449c47f5-b1b3-478d-b221-80aa9d3e4900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.172048 Aug 26 15:50:52.456174 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 65/132] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:52 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:52.785979 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2c23e1d1-309f-4efe-b3a0-f35da9db3505 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:52.786598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2c23e1d1-309f-4efe-b3a0-f35da9db3505 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:52.792792 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2c23e1d1-309f-4efe-b3a0-f35da9db3505 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:52.793290 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2c23e1d1-309f-4efe-b3a0-f35da9db3505 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:52.793710 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2c23e1d1-309f-4efe-b3a0-f35da9db3505 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:52.794410 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2c23e1d1-309f-4efe-b3a0-f35da9db3505 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:52.795516 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2c23e1d1-309f-4efe-b3a0-f35da9db3505 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:52.795968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2c23e1d1-309f-4efe-b3a0-f35da9db3505 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:52.932968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2c23e1d1-309f-4efe-b3a0-f35da9db3505 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:52.940557 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2c23e1d1-309f-4efe-b3a0-f35da9db3505 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.158611 Aug 26 15:50:52.941130 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 68/133] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:52 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:53.458836 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0d63222e-0e8a-4fcd-80f9-0f6b1f82499b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:53.459430 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0d63222e-0e8a-4fcd-80f9-0f6b1f82499b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:53.463244 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-732eb064-10f0-471b-96ef-a5c885385ac6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:53.463896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-732eb064-10f0-471b-96ef-a5c885385ac6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:53.465649 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d63222e-0e8a-4fcd-80f9-0f6b1f82499b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:53.466123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d63222e-0e8a-4fcd-80f9-0f6b1f82499b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:53.466577 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d63222e-0e8a-4fcd-80f9-0f6b1f82499b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:53.467261 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d63222e-0e8a-4fcd-80f9-0f6b1f82499b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:53.467704 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d63222e-0e8a-4fcd-80f9-0f6b1f82499b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:53.468144 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d63222e-0e8a-4fcd-80f9-0f6b1f82499b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:53.469758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-732eb064-10f0-471b-96ef-a5c885385ac6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:53.470342 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-732eb064-10f0-471b-96ef-a5c885385ac6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:53.470706 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-732eb064-10f0-471b-96ef-a5c885385ac6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:53.471391 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-732eb064-10f0-471b-96ef-a5c885385ac6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:53.471842 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-732eb064-10f0-471b-96ef-a5c885385ac6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:53.472578 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-732eb064-10f0-471b-96ef-a5c885385ac6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:53.716834 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-732eb064-10f0-471b-96ef-a5c885385ac6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:53.717259 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0d63222e-0e8a-4fcd-80f9-0f6b1f82499b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:53.717375 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-732eb064-10f0-471b-96ef-a5c885385ac6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.181276 Aug 26 15:50:53.717375 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 69/134] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:53 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:53.717602 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0d63222e-0e8a-4fcd-80f9-0f6b1f82499b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.193218 Aug 26 15:50:53.717602 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 66/135] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:53 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:53.961687 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-21136632-c66a-4f21-93ca-9c6e49be4508 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:53.962376 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-21136632-c66a-4f21-93ca-9c6e49be4508 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:53.969001 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21136632-c66a-4f21-93ca-9c6e49be4508 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:53.969461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21136632-c66a-4f21-93ca-9c6e49be4508 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:53.969885 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21136632-c66a-4f21-93ca-9c6e49be4508 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:53.970554 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21136632-c66a-4f21-93ca-9c6e49be4508 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:53.971001 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21136632-c66a-4f21-93ca-9c6e49be4508 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:53.971412 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21136632-c66a-4f21-93ca-9c6e49be4508 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:54.164365 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-21136632-c66a-4f21-93ca-9c6e49be4508 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:54.176529 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-21136632-c66a-4f21-93ca-9c6e49be4508 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.218740 Aug 26 15:50:54.179640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 70/136] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:53 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:54.271187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-9a9e5484-4403-495f-8b28-23eff3eb0e0e req-cc016a52-78fb-4d81-a0c0-16fa4727b49d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d429ff90-f8c3-47df-8bde-884a597251d6", "name": "network-vif-plugged", "status": "completed", "tag": "c56e18a2-a1c2-4bab-afa7-6e0bbf18ac6c"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:54.281899 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-9a9e5484-4403-495f-8b28-23eff3eb0e0e req-cc016a52-78fb-4d81-a0c0-16fa4727b49d service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:54.286128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-9a9e5484-4403-495f-8b28-23eff3eb0e0e req-cc016a52-78fb-4d81-a0c0-16fa4727b49d service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:54.286128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-9a9e5484-4403-495f-8b28-23eff3eb0e0e req-cc016a52-78fb-4d81-a0c0-16fa4727b49d service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:54.294088 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-9a9e5484-4403-495f-8b28-23eff3eb0e0e req-cc016a52-78fb-4d81-a0c0-16fa4727b49d service nova] Creating event network-vif-plugged:c56e18a2-a1c2-4bab-afa7-6e0bbf18ac6c for instance d429ff90-f8c3-47df-8bde-884a597251d6 on hv-cinder-83124 Aug 26 15:50:54.300823 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-9a9e5484-4403-495f-8b28-23eff3eb0e0e req-cc016a52-78fb-4d81-a0c0-16fa4727b49d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107362 Aug 26 15:50:54.301978 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 67/137] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:50:54.664398 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7008a5a8-ed48-46ec-acb7-22dcd3387844 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:54.665287 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7008a5a8-ed48-46ec-acb7-22dcd3387844 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:54.668365 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-ddb617b9-bdf3-49fa-8bf6-8f7851599a57 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:54.669596 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ddb617b9-bdf3-49fa-8bf6-8f7851599a57 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:54.681281 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7008a5a8-ed48-46ec-acb7-22dcd3387844 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:54.686343 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7008a5a8-ed48-46ec-acb7-22dcd3387844 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:54.686851 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ddb617b9-bdf3-49fa-8bf6-8f7851599a57 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:54.687427 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ddb617b9-bdf3-49fa-8bf6-8f7851599a57 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:54.688183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ddb617b9-bdf3-49fa-8bf6-8f7851599a57 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:54.688936 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ddb617b9-bdf3-49fa-8bf6-8f7851599a57 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:54.689453 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ddb617b9-bdf3-49fa-8bf6-8f7851599a57 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:54.690045 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ddb617b9-bdf3-49fa-8bf6-8f7851599a57 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:54.690542 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7008a5a8-ed48-46ec-acb7-22dcd3387844 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:54.691451 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7008a5a8-ed48-46ec-acb7-22dcd3387844 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:54.692114 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7008a5a8-ed48-46ec-acb7-22dcd3387844 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:54.692550 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7008a5a8-ed48-46ec-acb7-22dcd3387844 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:54.879641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ddb617b9-bdf3-49fa-8bf6-8f7851599a57 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:54.888028 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-ddb617b9-bdf3-49fa-8bf6-8f7851599a57 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.223746 Aug 26 15:50:54.890339 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 68/138] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:54 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:54.950712 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7008a5a8-ed48-46ec-acb7-22dcd3387844 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:54.978072 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7008a5a8-ed48-46ec-acb7-22dcd3387844 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.318785 Aug 26 15:50:54.980414 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 71/139] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:54 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:55.197230 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d243c2b2-da89-4ffe-841d-d49c6d6b56aa tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:55.197836 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d243c2b2-da89-4ffe-841d-d49c6d6b56aa tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:55.204216 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d243c2b2-da89-4ffe-841d-d49c6d6b56aa tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:55.204692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d243c2b2-da89-4ffe-841d-d49c6d6b56aa tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:55.205284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d243c2b2-da89-4ffe-841d-d49c6d6b56aa tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:55.205974 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d243c2b2-da89-4ffe-841d-d49c6d6b56aa tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:55.206418 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d243c2b2-da89-4ffe-841d-d49c6d6b56aa tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:55.206860 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d243c2b2-da89-4ffe-841d-d49c6d6b56aa tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:55.347361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d243c2b2-da89-4ffe-841d-d49c6d6b56aa tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:55.363149 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d243c2b2-da89-4ffe-841d-d49c6d6b56aa tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.169763 Aug 26 15:50:55.366634 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 69/140] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:55 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:55.908990 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-564bc43e-f01c-4e11-8bbd-89f7a6740c6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:55.909632 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-564bc43e-f01c-4e11-8bbd-89f7a6740c6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:55.915496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-564bc43e-f01c-4e11-8bbd-89f7a6740c6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:55.916010 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-564bc43e-f01c-4e11-8bbd-89f7a6740c6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:55.916447 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-564bc43e-f01c-4e11-8bbd-89f7a6740c6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:55.917129 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-564bc43e-f01c-4e11-8bbd-89f7a6740c6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:55.917749 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-564bc43e-f01c-4e11-8bbd-89f7a6740c6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:55.918168 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-564bc43e-f01c-4e11-8bbd-89f7a6740c6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:55.999071 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-4aa2f0c5-d9fe-435f-95af-91b2484d7678 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:55.999814 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-4aa2f0c5-d9fe-435f-95af-91b2484d7678 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:56.007452 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4aa2f0c5-d9fe-435f-95af-91b2484d7678 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:56.009945 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4aa2f0c5-d9fe-435f-95af-91b2484d7678 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:56.009945 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4aa2f0c5-d9fe-435f-95af-91b2484d7678 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:56.009945 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4aa2f0c5-d9fe-435f-95af-91b2484d7678 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:56.009945 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4aa2f0c5-d9fe-435f-95af-91b2484d7678 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:56.010260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4aa2f0c5-d9fe-435f-95af-91b2484d7678 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:56.053219 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-564bc43e-f01c-4e11-8bbd-89f7a6740c6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:56.061673 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-564bc43e-f01c-4e11-8bbd-89f7a6740c6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.157116 Aug 26 15:50:56.073291 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 72/141] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:55 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:56.157818 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-4aa2f0c5-d9fe-435f-95af-91b2484d7678 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:56.167564 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-4aa2f0c5-d9fe-435f-95af-91b2484d7678 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.172407 Aug 26 15:50:56.168191 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 70/142] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:55 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:56.317583 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-72577132-e3fe-4d33-adeb-09208729a781 req-3c501ba4-6807-4a78-941b-69e7967f576f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff835f8-1f60-42e7-b12f-bb08724decc6", "name": "network-vif-plugged", "status": "completed", "tag": "4b02b745-e421-4c5a-bf2a-85638bcc6243"}, {"server_uuid": "6bdeefc3-4622-43da-a414-d7813721bc01", "name": "network-vif-plugged", "status": "completed", "tag": "35e38d0a-ebb0-4877-bfe3-31b8806f3fde"}, {"server_uuid": "eae5c9c4-de22-4f03-a66b-3b0a632131e0", "name": "network-vif-plugged", "status": "completed", "tag": "57ccb93e-3e0c-4959-a846-0f9b661425bf"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:56.335516 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-72577132-e3fe-4d33-adeb-09208729a781 req-3c501ba4-6807-4a78-941b-69e7967f576f service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:56.336311 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-72577132-e3fe-4d33-adeb-09208729a781 req-3c501ba4-6807-4a78-941b-69e7967f576f service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:56.336749 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-72577132-e3fe-4d33-adeb-09208729a781 req-3c501ba4-6807-4a78-941b-69e7967f576f service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:56.352470 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-72577132-e3fe-4d33-adeb-09208729a781 req-3c501ba4-6807-4a78-941b-69e7967f576f service nova] Creating event network-vif-plugged:4b02b745-e421-4c5a-bf2a-85638bcc6243 for instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 on hv-cinder-83124 Aug 26 15:50:56.352974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-72577132-e3fe-4d33-adeb-09208729a781 req-3c501ba4-6807-4a78-941b-69e7967f576f service nova] Creating event network-vif-plugged:35e38d0a-ebb0-4877-bfe3-31b8806f3fde for instance 6bdeefc3-4622-43da-a414-d7813721bc01 on hv-cinder-83124 Aug 26 15:50:56.353466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-72577132-e3fe-4d33-adeb-09208729a781 req-3c501ba4-6807-4a78-941b-69e7967f576f service nova] Creating event network-vif-plugged:57ccb93e-3e0c-4959-a846-0f9b661425bf for instance eae5c9c4-de22-4f03-a66b-3b0a632131e0 on hv-cinder-83124 Aug 26 15:50:56.361663 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-72577132-e3fe-4d33-adeb-09208729a781 req-3c501ba4-6807-4a78-941b-69e7967f576f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.048122 Aug 26 15:50:56.362362 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 73/143] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:50:56.384253 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-ca9e62e8-8a9e-44e5-ab69-cf1356d48ae7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:56.384874 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ca9e62e8-8a9e-44e5-ab69-cf1356d48ae7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:56.416461 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ca9e62e8-8a9e-44e5-ab69-cf1356d48ae7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:56.417150 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ca9e62e8-8a9e-44e5-ab69-cf1356d48ae7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:56.417436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ca9e62e8-8a9e-44e5-ab69-cf1356d48ae7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:56.418327 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ca9e62e8-8a9e-44e5-ab69-cf1356d48ae7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:56.418788 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ca9e62e8-8a9e-44e5-ab69-cf1356d48ae7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:56.419217 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ca9e62e8-8a9e-44e5-ab69-cf1356d48ae7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:56.598880 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ca9e62e8-8a9e-44e5-ab69-cf1356d48ae7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:56.618966 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-ca9e62e8-8a9e-44e5-ab69-cf1356d48ae7 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.237932 Aug 26 15:50:56.621766 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 71/144] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:56 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:57.089767 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-9105815f-3212-48a5-8ee2-b0528eaf420f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:57.091610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-9105815f-3212-48a5-8ee2-b0528eaf420f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:57.099613 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9105815f-3212-48a5-8ee2-b0528eaf420f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:57.100348 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9105815f-3212-48a5-8ee2-b0528eaf420f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:57.100843 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9105815f-3212-48a5-8ee2-b0528eaf420f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:57.101809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9105815f-3212-48a5-8ee2-b0528eaf420f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:57.102339 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9105815f-3212-48a5-8ee2-b0528eaf420f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:57.102827 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9105815f-3212-48a5-8ee2-b0528eaf420f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:57.190116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9b90d931-6ba2-41b8-b6db-fcc6f6df99e5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:57.194673 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9b90d931-6ba2-41b8-b6db-fcc6f6df99e5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:57.199150 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b90d931-6ba2-41b8-b6db-fcc6f6df99e5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:57.199636 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b90d931-6ba2-41b8-b6db-fcc6f6df99e5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:57.200100 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b90d931-6ba2-41b8-b6db-fcc6f6df99e5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:57.200805 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b90d931-6ba2-41b8-b6db-fcc6f6df99e5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:57.202012 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b90d931-6ba2-41b8-b6db-fcc6f6df99e5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:57.202473 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b90d931-6ba2-41b8-b6db-fcc6f6df99e5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:57.245297 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-9105815f-3212-48a5-8ee2-b0528eaf420f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:57.253279 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-9105815f-3212-48a5-8ee2-b0528eaf420f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1322 microversion: 2.1 time: 0.173724 Aug 26 15:50:57.257671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 74/145] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:57 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:57.343281 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9b90d931-6ba2-41b8-b6db-fcc6f6df99e5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:57.353684 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9b90d931-6ba2-41b8-b6db-fcc6f6df99e5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.166059 Aug 26 15:50:57.353684 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 72/146] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:57 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:57.656712 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d2647599-5285-429c-83c7-b8ddc28a8350 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:57.657326 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d2647599-5285-429c-83c7-b8ddc28a8350 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:57.663591 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d2647599-5285-429c-83c7-b8ddc28a8350 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:57.664127 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d2647599-5285-429c-83c7-b8ddc28a8350 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:57.664566 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d2647599-5285-429c-83c7-b8ddc28a8350 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:57.665253 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d2647599-5285-429c-83c7-b8ddc28a8350 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:57.665707 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d2647599-5285-429c-83c7-b8ddc28a8350 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:57.666128 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d2647599-5285-429c-83c7-b8ddc28a8350 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:57.799388 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d2647599-5285-429c-83c7-b8ddc28a8350 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:57.814008 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d2647599-5285-429c-83c7-b8ddc28a8350 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.155819 Aug 26 15:50:57.814008 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 75/147] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:57 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:58.280418 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-494cd2bb-8ddb-4a00-949c-156e89284804 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:58.280418 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-494cd2bb-8ddb-4a00-949c-156e89284804 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:58.281130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-494cd2bb-8ddb-4a00-949c-156e89284804 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:58.281629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-494cd2bb-8ddb-4a00-949c-156e89284804 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:58.282052 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-494cd2bb-8ddb-4a00-949c-156e89284804 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:58.282798 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-494cd2bb-8ddb-4a00-949c-156e89284804 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:58.284062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-494cd2bb-8ddb-4a00-949c-156e89284804 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:58.284062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-494cd2bb-8ddb-4a00-949c-156e89284804 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:58.371976 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e8b26cd0-6937-4a30-bd84-c07e9981ae90 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:58.372623 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e8b26cd0-6937-4a30-bd84-c07e9981ae90 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:58.379432 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e8b26cd0-6937-4a30-bd84-c07e9981ae90 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:58.379954 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e8b26cd0-6937-4a30-bd84-c07e9981ae90 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:58.380565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e8b26cd0-6937-4a30-bd84-c07e9981ae90 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:58.381540 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e8b26cd0-6937-4a30-bd84-c07e9981ae90 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:58.381996 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e8b26cd0-6937-4a30-bd84-c07e9981ae90 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:58.382420 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e8b26cd0-6937-4a30-bd84-c07e9981ae90 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:58.435249 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-494cd2bb-8ddb-4a00-949c-156e89284804 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:58.443673 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-494cd2bb-8ddb-4a00-949c-156e89284804 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1516 microversion: 2.1 time: 0.173535 Aug 26 15:50:58.444424 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 73/148] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:58 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:58.465057 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c7836eb8-218f-4e8f-a6f1-0db504352e5d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:58.468152 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c7836eb8-218f-4e8f-a6f1-0db504352e5d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:58.474350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7836eb8-218f-4e8f-a6f1-0db504352e5d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:58.475170 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7836eb8-218f-4e8f-a6f1-0db504352e5d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:58.475620 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7836eb8-218f-4e8f-a6f1-0db504352e5d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:58.476355 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7836eb8-218f-4e8f-a6f1-0db504352e5d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:58.476806 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7836eb8-218f-4e8f-a6f1-0db504352e5d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:58.477229 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7836eb8-218f-4e8f-a6f1-0db504352e5d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:58.512430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e8b26cd0-6937-4a30-bd84-c07e9981ae90 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:58.520872 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e8b26cd0-6937-4a30-bd84-c07e9981ae90 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.153024 Aug 26 15:50:58.521379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 76/149] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:58 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:58.540959 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-c7836eb8-218f-4e8f-a6f1-0db504352e5d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lazy-loading 'flavor' on Instance uuid d429ff90-f8c3-47df-8bde-884a597251d6 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:50:58.833197 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e80ed50a-cd89-4388-b515-1df6751e60e0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:58.833805 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e80ed50a-cd89-4388-b515-1df6751e60e0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:58.839861 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e80ed50a-cd89-4388-b515-1df6751e60e0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:58.841416 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e80ed50a-cd89-4388-b515-1df6751e60e0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:58.841416 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e80ed50a-cd89-4388-b515-1df6751e60e0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:58.841416 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e80ed50a-cd89-4388-b515-1df6751e60e0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:58.841980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e80ed50a-cd89-4388-b515-1df6751e60e0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:58.842368 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e80ed50a-cd89-4388-b515-1df6751e60e0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:58.970311 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e80ed50a-cd89-4388-b515-1df6751e60e0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:58.977874 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e80ed50a-cd89-4388-b515-1df6751e60e0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.148660 Aug 26 15:50:58.978519 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 77/150] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:58 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:50:59.006087 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c7836eb8-218f-4e8f-a6f1-0db504352e5d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "POST /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6/action" status: 200 len: 32 microversion: 2.1 time: 0.544910 Aug 26 15:50:59.006688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 74/151] 10.222.0.98 () {60 vars in 1278 bytes} [Fri Aug 26 15:50:58 2022] POST /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6/action => generated 32 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 15:50:59.015951 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5c2bc20b-4a4c-4568-ab91-7633eaf8c260 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:59.016615 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5c2bc20b-4a4c-4568-ab91-7633eaf8c260 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:59.022521 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c2bc20b-4a4c-4568-ab91-7633eaf8c260 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:59.024060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c2bc20b-4a4c-4568-ab91-7633eaf8c260 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:59.024060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c2bc20b-4a4c-4568-ab91-7633eaf8c260 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:59.024257 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c2bc20b-4a4c-4568-ab91-7633eaf8c260 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:59.024663 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c2bc20b-4a4c-4568-ab91-7633eaf8c260 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:59.025139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c2bc20b-4a4c-4568-ab91-7633eaf8c260 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:59.160629 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-5c2bc20b-4a4c-4568-ab91-7633eaf8c260 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:59.168212 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5c2bc20b-4a4c-4568-ab91-7633eaf8c260 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.156011 Aug 26 15:50:59.168782 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 78/152] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:59 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:59.541816 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1f8f9792-0ba5-4b9c-bb11-09f15c017687 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:59.542571 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1f8f9792-0ba5-4b9c-bb11-09f15c017687 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:50:59.549343 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f8f9792-0ba5-4b9c-bb11-09f15c017687 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:59.549825 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f8f9792-0ba5-4b9c-bb11-09f15c017687 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:59.550259 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f8f9792-0ba5-4b9c-bb11-09f15c017687 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:59.550946 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f8f9792-0ba5-4b9c-bb11-09f15c017687 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:50:59.551397 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f8f9792-0ba5-4b9c-bb11-09f15c017687 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:50:59.551822 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f8f9792-0ba5-4b9c-bb11-09f15c017687 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:50:59.703135 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1f8f9792-0ba5-4b9c-bb11-09f15c017687 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:50:59.703270 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1f8f9792-0ba5-4b9c-bb11-09f15c017687 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.165681 Aug 26 15:50:59.703793 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 75/153] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:59 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:59.999328 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d435f93f-963f-4d95-98f6-275cd621c784 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:59.999980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d435f93f-963f-4d95-98f6-275cd621c784 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:00.005884 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d435f93f-963f-4d95-98f6-275cd621c784 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:00.006367 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d435f93f-963f-4d95-98f6-275cd621c784 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:00.006807 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d435f93f-963f-4d95-98f6-275cd621c784 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:00.007496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d435f93f-963f-4d95-98f6-275cd621c784 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:00.008002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d435f93f-963f-4d95-98f6-275cd621c784 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:00.008436 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d435f93f-963f-4d95-98f6-275cd621c784 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:00.146997 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d435f93f-963f-4d95-98f6-275cd621c784 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:00.160823 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d435f93f-963f-4d95-98f6-275cd621c784 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.165107 Aug 26 15:51:00.161300 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 79/154] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:50:59 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:00.189749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-70700701-d88c-43e3-a7d9-1e02d2251278 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:00.190355 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-70700701-d88c-43e3-a7d9-1e02d2251278 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:00.196560 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-70700701-d88c-43e3-a7d9-1e02d2251278 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:00.197032 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-70700701-d88c-43e3-a7d9-1e02d2251278 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:00.197461 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-70700701-d88c-43e3-a7d9-1e02d2251278 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:00.198139 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-70700701-d88c-43e3-a7d9-1e02d2251278 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:00.198585 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-70700701-d88c-43e3-a7d9-1e02d2251278 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:00.199002 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-70700701-d88c-43e3-a7d9-1e02d2251278 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:00.335974 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-70700701-d88c-43e3-a7d9-1e02d2251278 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:00.341302 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-70700701-d88c-43e3-a7d9-1e02d2251278 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.155381 Aug 26 15:51:00.342602 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 76/155] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:00 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:00.724367 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c1206bb1-957b-4f55-94b3-398d95d024b1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:00.725481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c1206bb1-957b-4f55-94b3-398d95d024b1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:00.737096 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c1206bb1-957b-4f55-94b3-398d95d024b1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:00.737974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c1206bb1-957b-4f55-94b3-398d95d024b1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:00.738619 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c1206bb1-957b-4f55-94b3-398d95d024b1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:00.739641 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c1206bb1-957b-4f55-94b3-398d95d024b1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:00.740230 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c1206bb1-957b-4f55-94b3-398d95d024b1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:00.740759 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c1206bb1-957b-4f55-94b3-398d95d024b1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:00.898969 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c1206bb1-957b-4f55-94b3-398d95d024b1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:00.907105 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c1206bb1-957b-4f55-94b3-398d95d024b1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.186882 Aug 26 15:51:00.916055 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 80/156] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:00 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:01.191794 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5655ed77-ef58-4257-97c5-7f4a75eebca0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:01.192565 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5655ed77-ef58-4257-97c5-7f4a75eebca0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:01.199042 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5655ed77-ef58-4257-97c5-7f4a75eebca0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:01.199803 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5655ed77-ef58-4257-97c5-7f4a75eebca0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:01.200334 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5655ed77-ef58-4257-97c5-7f4a75eebca0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:01.201070 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5655ed77-ef58-4257-97c5-7f4a75eebca0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:01.201535 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5655ed77-ef58-4257-97c5-7f4a75eebca0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:01.201951 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5655ed77-ef58-4257-97c5-7f4a75eebca0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:01.363815 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-beb8c67a-a4ea-4cdb-b0c9-17a78ba704ca tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:01.364542 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-beb8c67a-a4ea-4cdb-b0c9-17a78ba704ca tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:01.365386 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5655ed77-ef58-4257-97c5-7f4a75eebca0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:01.372532 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-beb8c67a-a4ea-4cdb-b0c9-17a78ba704ca tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:01.374023 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-beb8c67a-a4ea-4cdb-b0c9-17a78ba704ca tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:01.374473 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-beb8c67a-a4ea-4cdb-b0c9-17a78ba704ca tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:01.375231 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-beb8c67a-a4ea-4cdb-b0c9-17a78ba704ca tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:01.375688 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-beb8c67a-a4ea-4cdb-b0c9-17a78ba704ca tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:01.376147 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-beb8c67a-a4ea-4cdb-b0c9-17a78ba704ca tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:01.378653 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5655ed77-ef58-4257-97c5-7f4a75eebca0 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.190577 Aug 26 15:51:01.390498 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 77/157] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:01 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:01.705769 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-beb8c67a-a4ea-4cdb-b0c9-17a78ba704ca tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:01.713433 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-beb8c67a-a4ea-4cdb-b0c9-17a78ba704ca tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.354152 Aug 26 15:51:01.713992 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 81/158] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:01 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:01.930865 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1bea853f-3145-41b3-9268-25d5119e5b33 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:01.931481 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1bea853f-3145-41b3-9268-25d5119e5b33 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:01.938107 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1bea853f-3145-41b3-9268-25d5119e5b33 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:01.938759 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1bea853f-3145-41b3-9268-25d5119e5b33 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:01.939359 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1bea853f-3145-41b3-9268-25d5119e5b33 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:01.944847 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1bea853f-3145-41b3-9268-25d5119e5b33 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:01.944847 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1bea853f-3145-41b3-9268-25d5119e5b33 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:01.944847 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1bea853f-3145-41b3-9268-25d5119e5b33 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:02.090909 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1bea853f-3145-41b3-9268-25d5119e5b33 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:02.100086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1bea853f-3145-41b3-9268-25d5119e5b33 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.175330 Aug 26 15:51:02.100673 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 78/159] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:01 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:51:02.407112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-be5b5d3e-e5d7-420b-b769-c6f76cbbcfb6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:02.407995 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-be5b5d3e-e5d7-420b-b769-c6f76cbbcfb6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:02.414669 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-be5b5d3e-e5d7-420b-b769-c6f76cbbcfb6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:02.415165 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-be5b5d3e-e5d7-420b-b769-c6f76cbbcfb6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:02.415616 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-be5b5d3e-e5d7-420b-b769-c6f76cbbcfb6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:02.416327 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-be5b5d3e-e5d7-420b-b769-c6f76cbbcfb6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:02.416792 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-be5b5d3e-e5d7-420b-b769-c6f76cbbcfb6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:02.417213 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-be5b5d3e-e5d7-420b-b769-c6f76cbbcfb6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:02.565801 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-be5b5d3e-e5d7-420b-b769-c6f76cbbcfb6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:02.569348 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=100 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:02.573834 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-be5b5d3e-e5d7-420b-b769-c6f76cbbcfb6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1314 microversion: 2.1 time: 0.171571 Aug 26 15:51:02.587579 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 82/160] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:02 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:02.734630 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-be8e8530-9be1-4b56-8ff6-ae523fe32fac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:02.735251 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-be8e8530-9be1-4b56-8ff6-ae523fe32fac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:02.741347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-be8e8530-9be1-4b56-8ff6-ae523fe32fac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:02.741829 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-be8e8530-9be1-4b56-8ff6-ae523fe32fac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:02.742274 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-be8e8530-9be1-4b56-8ff6-ae523fe32fac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:02.742963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-be8e8530-9be1-4b56-8ff6-ae523fe32fac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:02.743527 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-be8e8530-9be1-4b56-8ff6-ae523fe32fac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:02.744061 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-be8e8530-9be1-4b56-8ff6-ae523fe32fac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:02.885812 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-be8e8530-9be1-4b56-8ff6-ae523fe32fac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:02.885812 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:02.890450 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-be8e8530-9be1-4b56-8ff6-ae523fe32fac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.159673 Aug 26 15:51:02.906666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 79/161] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:02 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:03.125697 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f665b9c4-6cdd-409c-b5ac-6fea774a8ccb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:03.127082 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f665b9c4-6cdd-409c-b5ac-6fea774a8ccb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:03.134211 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f665b9c4-6cdd-409c-b5ac-6fea774a8ccb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:03.134793 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f665b9c4-6cdd-409c-b5ac-6fea774a8ccb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:03.135505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f665b9c4-6cdd-409c-b5ac-6fea774a8ccb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:03.136331 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f665b9c4-6cdd-409c-b5ac-6fea774a8ccb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:03.137426 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f665b9c4-6cdd-409c-b5ac-6fea774a8ccb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:03.137937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f665b9c4-6cdd-409c-b5ac-6fea774a8ccb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:03.323989 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f665b9c4-6cdd-409c-b5ac-6fea774a8ccb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:03.333794 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f665b9c4-6cdd-409c-b5ac-6fea774a8ccb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.216525 Aug 26 15:51:03.335017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 83/162] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:03 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:03.606654 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-3cc4a355-a7cc-4df9-a8ce-84819e75bdf1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:03.607357 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-3cc4a355-a7cc-4df9-a8ce-84819e75bdf1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:03.613849 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3cc4a355-a7cc-4df9-a8ce-84819e75bdf1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:03.614329 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3cc4a355-a7cc-4df9-a8ce-84819e75bdf1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:03.614760 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3cc4a355-a7cc-4df9-a8ce-84819e75bdf1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:03.615453 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3cc4a355-a7cc-4df9-a8ce-84819e75bdf1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:03.615927 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3cc4a355-a7cc-4df9-a8ce-84819e75bdf1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:03.616360 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3cc4a355-a7cc-4df9-a8ce-84819e75bdf1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:03.781035 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-3cc4a355-a7cc-4df9-a8ce-84819e75bdf1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:03.789086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-3cc4a355-a7cc-4df9-a8ce-84819e75bdf1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1500 microversion: 2.1 time: 0.187305 Aug 26 15:51:03.789668 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 80/163] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:03 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1500 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:03.911940 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-bcae12a2-b2bb-4f6e-aa4c-4338a06d9bd1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:03.913121 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-bcae12a2-b2bb-4f6e-aa4c-4338a06d9bd1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:03.921451 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bcae12a2-b2bb-4f6e-aa4c-4338a06d9bd1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:03.922285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bcae12a2-b2bb-4f6e-aa4c-4338a06d9bd1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:03.922718 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bcae12a2-b2bb-4f6e-aa4c-4338a06d9bd1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:03.923995 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bcae12a2-b2bb-4f6e-aa4c-4338a06d9bd1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:03.924406 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bcae12a2-b2bb-4f6e-aa4c-4338a06d9bd1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:03.924825 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bcae12a2-b2bb-4f6e-aa4c-4338a06d9bd1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:04.130745 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-bcae12a2-b2bb-4f6e-aa4c-4338a06d9bd1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:04.139686 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-bcae12a2-b2bb-4f6e-aa4c-4338a06d9bd1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.232113 Aug 26 15:51:04.140536 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 84/164] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:03 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:04.354627 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-67dbdf77-8a0a-4443-a00d-9308d3a3e4d4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:04.355240 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-67dbdf77-8a0a-4443-a00d-9308d3a3e4d4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:04.362013 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-67dbdf77-8a0a-4443-a00d-9308d3a3e4d4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:04.362502 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-67dbdf77-8a0a-4443-a00d-9308d3a3e4d4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:04.362942 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-67dbdf77-8a0a-4443-a00d-9308d3a3e4d4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:04.363644 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-67dbdf77-8a0a-4443-a00d-9308d3a3e4d4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:04.364124 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-67dbdf77-8a0a-4443-a00d-9308d3a3e4d4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:04.364548 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-67dbdf77-8a0a-4443-a00d-9308d3a3e4d4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:04.528108 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-67dbdf77-8a0a-4443-a00d-9308d3a3e4d4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:04.535809 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-67dbdf77-8a0a-4443-a00d-9308d3a3e4d4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.185019 Aug 26 15:51:04.536529 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 81/165] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:04 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:05.160671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8f5d901b-2141-4398-bec9-d5a7a7476341 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:05.161272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-8f5d901b-2141-4398-bec9-d5a7a7476341 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:05.167539 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f5d901b-2141-4398-bec9-d5a7a7476341 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:05.168053 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f5d901b-2141-4398-bec9-d5a7a7476341 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:05.168519 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f5d901b-2141-4398-bec9-d5a7a7476341 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:05.169174 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f5d901b-2141-4398-bec9-d5a7a7476341 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:05.169625 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f5d901b-2141-4398-bec9-d5a7a7476341 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:05.170676 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f5d901b-2141-4398-bec9-d5a7a7476341 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:05.302676 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8f5d901b-2141-4398-bec9-d5a7a7476341 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:05.311504 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-8f5d901b-2141-4398-bec9-d5a7a7476341 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.154785 Aug 26 15:51:05.325037 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 85/166] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:05 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:05.556719 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-4c031d73-feb3-4ac7-81f1-d093808eb9b7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:05.557897 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-4c031d73-feb3-4ac7-81f1-d093808eb9b7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:05.565528 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4c031d73-feb3-4ac7-81f1-d093808eb9b7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:05.566151 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4c031d73-feb3-4ac7-81f1-d093808eb9b7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:05.566818 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4c031d73-feb3-4ac7-81f1-d093808eb9b7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:05.567623 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4c031d73-feb3-4ac7-81f1-d093808eb9b7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:05.568214 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4c031d73-feb3-4ac7-81f1-d093808eb9b7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:05.568763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4c031d73-feb3-4ac7-81f1-d093808eb9b7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:05.713215 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-4c031d73-feb3-4ac7-81f1-d093808eb9b7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:05.721507 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-4c031d73-feb3-4ac7-81f1-d093808eb9b7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.168796 Aug 26 15:51:05.722075 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 82/167] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:05 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:06.333102 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-430f9e60-f1e8-4b1d-9aff-2d0997b2df05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:06.334368 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-430f9e60-f1e8-4b1d-9aff-2d0997b2df05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:06.341142 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-430f9e60-f1e8-4b1d-9aff-2d0997b2df05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:06.341658 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-430f9e60-f1e8-4b1d-9aff-2d0997b2df05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:06.342092 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-430f9e60-f1e8-4b1d-9aff-2d0997b2df05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:06.342781 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-430f9e60-f1e8-4b1d-9aff-2d0997b2df05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:06.343232 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-430f9e60-f1e8-4b1d-9aff-2d0997b2df05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:06.343650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-430f9e60-f1e8-4b1d-9aff-2d0997b2df05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:06.509115 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-430f9e60-f1e8-4b1d-9aff-2d0997b2df05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:06.518094 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-430f9e60-f1e8-4b1d-9aff-2d0997b2df05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.188807 Aug 26 15:51:06.518678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 86/168] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:06 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:06.742295 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0d9e88c9-d90c-4edf-be79-15277d0b3d0b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:06.742909 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0d9e88c9-d90c-4edf-be79-15277d0b3d0b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:06.749566 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d9e88c9-d90c-4edf-be79-15277d0b3d0b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:06.750041 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d9e88c9-d90c-4edf-be79-15277d0b3d0b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:06.750461 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d9e88c9-d90c-4edf-be79-15277d0b3d0b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:06.751137 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d9e88c9-d90c-4edf-be79-15277d0b3d0b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:06.751579 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d9e88c9-d90c-4edf-be79-15277d0b3d0b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:06.752038 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0d9e88c9-d90c-4edf-be79-15277d0b3d0b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:06.933792 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0d9e88c9-d90c-4edf-be79-15277d0b3d0b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:06.949242 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0d9e88c9-d90c-4edf-be79-15277d0b3d0b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1362 microversion: 2.1 time: 0.210994 Aug 26 15:51:06.950579 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 83/169] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:06 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:07.547669 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d0652c09-4285-4603-8cf0-e9a853d8e306 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:07.549037 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d0652c09-4285-4603-8cf0-e9a853d8e306 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:07.556375 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0652c09-4285-4603-8cf0-e9a853d8e306 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:07.557184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0652c09-4285-4603-8cf0-e9a853d8e306 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:07.557958 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0652c09-4285-4603-8cf0-e9a853d8e306 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:07.558874 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0652c09-4285-4603-8cf0-e9a853d8e306 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:07.559822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0652c09-4285-4603-8cf0-e9a853d8e306 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:07.560918 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0652c09-4285-4603-8cf0-e9a853d8e306 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:07.723957 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d0652c09-4285-4603-8cf0-e9a853d8e306 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:07.731652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d0652c09-4285-4603-8cf0-e9a853d8e306 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.190473 Aug 26 15:51:07.732296 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 87/170] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:07 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:07.937249 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a0dd5995-0f10-49e3-8d77-a3f10d1c169d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87cdf03a-93c9-4e67-9ae3-cd2f0914b103"}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:51:07.939692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a0dd5995-0f10-49e3-8d77-a3f10d1c169d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:07.945773 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a0dd5995-0f10-49e3-8d77-a3f10d1c169d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:07.946264 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a0dd5995-0f10-49e3-8d77-a3f10d1c169d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:07.946700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a0dd5995-0f10-49e3-8d77-a3f10d1c169d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:07.947384 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a0dd5995-0f10-49e3-8d77-a3f10d1c169d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:07.947834 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a0dd5995-0f10-49e3-8d77-a3f10d1c169d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:07.948282 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a0dd5995-0f10-49e3-8d77-a3f10d1c169d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:07.972809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0041b0ac-8273-4b8b-adc9-7a960943f4de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:07.973380 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0041b0ac-8273-4b8b-adc9-7a960943f4de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:07.979517 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0041b0ac-8273-4b8b-adc9-7a960943f4de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:07.980067 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0041b0ac-8273-4b8b-adc9-7a960943f4de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:07.980551 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0041b0ac-8273-4b8b-adc9-7a960943f4de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:07.981207 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0041b0ac-8273-4b8b-adc9-7a960943f4de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:07.981900 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0041b0ac-8273-4b8b-adc9-7a960943f4de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:07.982381 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0041b0ac-8273-4b8b-adc9-7a960943f4de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:08.137904 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0041b0ac-8273-4b8b-adc9-7a960943f4de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:08.146649 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0041b0ac-8273-4b8b-adc9-7a960943f4de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1548 microversion: 2.1 time: 0.177714 Aug 26 15:51:08.149967 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 88/171] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:07 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:51:08.168271 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2825c653-c88b-45f6-a6c4-95f742368b47 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:08.173041 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2825c653-c88b-45f6-a6c4-95f742368b47 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:08.174960 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2825c653-c88b-45f6-a6c4-95f742368b47 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:08.175448 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2825c653-c88b-45f6-a6c4-95f742368b47 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:08.175964 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2825c653-c88b-45f6-a6c4-95f742368b47 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:08.176689 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2825c653-c88b-45f6-a6c4-95f742368b47 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:08.177162 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2825c653-c88b-45f6-a6c4-95f742368b47 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:08.177578 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2825c653-c88b-45f6-a6c4-95f742368b47 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:08.300226 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2825c653-c88b-45f6-a6c4-95f742368b47 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135954 Aug 26 15:51:08.300822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 89/172] 10.222.0.98 () {58 vars in 1275 bytes} [Fri Aug 26 15:51:08 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:51:08.759350 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5dfbf9ea-3861-42bb-8c72-f3445b125348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:08.759350 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5dfbf9ea-3861-42bb-8c72-f3445b125348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:08.764579 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5dfbf9ea-3861-42bb-8c72-f3445b125348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:08.765086 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5dfbf9ea-3861-42bb-8c72-f3445b125348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:08.765511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5dfbf9ea-3861-42bb-8c72-f3445b125348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:08.766213 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5dfbf9ea-3861-42bb-8c72-f3445b125348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:08.766685 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5dfbf9ea-3861-42bb-8c72-f3445b125348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:08.767145 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5dfbf9ea-3861-42bb-8c72-f3445b125348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:08.953503 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-5dfbf9ea-3861-42bb-8c72-f3445b125348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:08.964288 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5dfbf9ea-3861-42bb-8c72-f3445b125348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.212255 Aug 26 15:51:08.965507 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 90/173] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:08 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:09.990179 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5552f214-5975-4392-a09d-821df0ff53f4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:09.992261 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5552f214-5975-4392-a09d-821df0ff53f4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:10.008127 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5552f214-5975-4392-a09d-821df0ff53f4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:10.008295 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a0dd5995-0f10-49e3-8d77-a3f10d1c169d tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "POST /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.073981 Aug 26 15:51:10.008729 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5552f214-5975-4392-a09d-821df0ff53f4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:10.008729 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5552f214-5975-4392-a09d-821df0ff53f4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:10.009690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5552f214-5975-4392-a09d-821df0ff53f4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:10.010295 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5552f214-5975-4392-a09d-821df0ff53f4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:10.011228 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5552f214-5975-4392-a09d-821df0ff53f4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:10.012812 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 84/174] 10.222.0.98 () {60 vars in 1323 bytes} [Fri Aug 26 15:51:07 2022] POST /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6/os-volume_attachments => generated 194 bytes in 2081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:51:10.200719 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-415a0a91-3599-48f2-8b4b-b3e7572e650b req-62dc129a-b681-4aed-b260-1f057edd07a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bdeefc3-4622-43da-a414-d7813721bc01", "tag": "35e38d0a-ebb0-4877-bfe3-31b8806f3fde"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:51:10.213385 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-415a0a91-3599-48f2-8b4b-b3e7572e650b req-62dc129a-b681-4aed-b260-1f057edd07a8 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:10.213936 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-415a0a91-3599-48f2-8b4b-b3e7572e650b req-62dc129a-b681-4aed-b260-1f057edd07a8 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:10.214704 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-415a0a91-3599-48f2-8b4b-b3e7572e650b req-62dc129a-b681-4aed-b260-1f057edd07a8 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:10.224558 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-5552f214-5975-4392-a09d-821df0ff53f4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:10.233373 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-415a0a91-3599-48f2-8b4b-b3e7572e650b req-62dc129a-b681-4aed-b260-1f057edd07a8 service nova] Creating event network-changed:35e38d0a-ebb0-4877-bfe3-31b8806f3fde for instance 6bdeefc3-4622-43da-a414-d7813721bc01 on hv-cinder-83124 Aug 26 15:51:10.236601 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5552f214-5975-4392-a09d-821df0ff53f4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.252950 Aug 26 15:51:10.241008 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-415a0a91-3599-48f2-8b4b-b3e7572e650b req-62dc129a-b681-4aed-b260-1f057edd07a8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044689 Aug 26 15:51:10.241890 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 85/175] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:51:10.250363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 91/176] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:09 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:51:11.261029 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-83f38f89-82d7-4cb2-8ebb-a6ef26e95863 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:11.262447 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-83f38f89-82d7-4cb2-8ebb-a6ef26e95863 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:11.271935 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-83f38f89-82d7-4cb2-8ebb-a6ef26e95863 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:11.272753 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-83f38f89-82d7-4cb2-8ebb-a6ef26e95863 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:11.274058 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-83f38f89-82d7-4cb2-8ebb-a6ef26e95863 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:11.275023 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-83f38f89-82d7-4cb2-8ebb-a6ef26e95863 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:11.275890 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-83f38f89-82d7-4cb2-8ebb-a6ef26e95863 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:11.276570 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-83f38f89-82d7-4cb2-8ebb-a6ef26e95863 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:11.443125 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-83f38f89-82d7-4cb2-8ebb-a6ef26e95863 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:11.459941 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-83f38f89-82d7-4cb2-8ebb-a6ef26e95863 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.205747 Aug 26 15:51:11.460907 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 86/177] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:11 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:12.480106 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-826599fe-e338-42f1-a08e-8ff61598826d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:12.480723 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-826599fe-e338-42f1-a08e-8ff61598826d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:12.482633 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=96 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:12.487262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-826599fe-e338-42f1-a08e-8ff61598826d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:12.487741 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-826599fe-e338-42f1-a08e-8ff61598826d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:12.488225 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-826599fe-e338-42f1-a08e-8ff61598826d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:12.488901 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-826599fe-e338-42f1-a08e-8ff61598826d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:12.489348 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-826599fe-e338-42f1-a08e-8ff61598826d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:12.489768 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-826599fe-e338-42f1-a08e-8ff61598826d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:12.628292 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-826599fe-e338-42f1-a08e-8ff61598826d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:12.635907 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-826599fe-e338-42f1-a08e-8ff61598826d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.159738 Aug 26 15:51:12.636462 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 92/178] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:12 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:13.661805 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-fe3e36b6-09cf-4072-9839-20a23faf566e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:13.661805 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-fe3e36b6-09cf-4072-9839-20a23faf566e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:13.670831 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fe3e36b6-09cf-4072-9839-20a23faf566e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:13.671499 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fe3e36b6-09cf-4072-9839-20a23faf566e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:13.671988 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fe3e36b6-09cf-4072-9839-20a23faf566e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:13.673112 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fe3e36b6-09cf-4072-9839-20a23faf566e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:13.673637 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fe3e36b6-09cf-4072-9839-20a23faf566e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:13.674182 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fe3e36b6-09cf-4072-9839-20a23faf566e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:13.879603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-fe3e36b6-09cf-4072-9839-20a23faf566e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:13.890714 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-fe3e36b6-09cf-4072-9839-20a23faf566e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.236897 Aug 26 15:51:13.891508 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 87/179] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:13 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:14.912516 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-27483e17-7110-42f9-8920-374dfaa73149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:14.915023 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-27483e17-7110-42f9-8920-374dfaa73149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:14.924260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27483e17-7110-42f9-8920-374dfaa73149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:14.926468 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27483e17-7110-42f9-8920-374dfaa73149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:14.926468 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27483e17-7110-42f9-8920-374dfaa73149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:14.926468 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27483e17-7110-42f9-8920-374dfaa73149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:14.926933 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27483e17-7110-42f9-8920-374dfaa73149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:14.927358 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27483e17-7110-42f9-8920-374dfaa73149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:15.069903 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-27483e17-7110-42f9-8920-374dfaa73149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:15.078448 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-27483e17-7110-42f9-8920-374dfaa73149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.171060 Aug 26 15:51:15.079029 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 93/180] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:14 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:16.100004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-07547359-f325-46fd-b656-0e66950f6878 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:16.100609 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-07547359-f325-46fd-b656-0e66950f6878 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:16.107775 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07547359-f325-46fd-b656-0e66950f6878 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:16.108358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07547359-f325-46fd-b656-0e66950f6878 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:16.109131 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07547359-f325-46fd-b656-0e66950f6878 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:16.110289 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07547359-f325-46fd-b656-0e66950f6878 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:16.110542 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07547359-f325-46fd-b656-0e66950f6878 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:16.110786 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07547359-f325-46fd-b656-0e66950f6878 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:16.254722 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-07547359-f325-46fd-b656-0e66950f6878 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:16.263286 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-07547359-f325-46fd-b656-0e66950f6878 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.167295 Aug 26 15:51:16.263949 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 88/181] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:16 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:17.284537 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-eea74500-d945-4f01-b6e4-dfd5052141d1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:17.285169 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-eea74500-d945-4f01-b6e4-dfd5052141d1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:17.291426 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-eea74500-d945-4f01-b6e4-dfd5052141d1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:17.292061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-eea74500-d945-4f01-b6e4-dfd5052141d1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:17.292499 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-eea74500-d945-4f01-b6e4-dfd5052141d1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:17.293291 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-eea74500-d945-4f01-b6e4-dfd5052141d1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:17.293853 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-eea74500-d945-4f01-b6e4-dfd5052141d1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:17.294511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-eea74500-d945-4f01-b6e4-dfd5052141d1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:17.466957 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-eea74500-d945-4f01-b6e4-dfd5052141d1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:17.474817 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-eea74500-d945-4f01-b6e4-dfd5052141d1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.194303 Aug 26 15:51:17.475413 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 94/182] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:17 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:18.496465 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-2ccd49ca-96a2-4d3c-94b9-ba6eca2f4077 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:18.497103 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-2ccd49ca-96a2-4d3c-94b9-ba6eca2f4077 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:18.499712 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=73 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:18.504490 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2ccd49ca-96a2-4d3c-94b9-ba6eca2f4077 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:18.505624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2ccd49ca-96a2-4d3c-94b9-ba6eca2f4077 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:18.505624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2ccd49ca-96a2-4d3c-94b9-ba6eca2f4077 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:18.506322 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2ccd49ca-96a2-4d3c-94b9-ba6eca2f4077 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:18.506623 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2ccd49ca-96a2-4d3c-94b9-ba6eca2f4077 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:18.507133 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2ccd49ca-96a2-4d3c-94b9-ba6eca2f4077 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:18.642645 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2ccd49ca-96a2-4d3c-94b9-ba6eca2f4077 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:18.648437 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-2ccd49ca-96a2-4d3c-94b9-ba6eca2f4077 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.155990 Aug 26 15:51:18.649171 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 89/183] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:18 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:19.670447 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2f3cc076-8153-4b84-b7c3-bb3071c35a3a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:19.670839 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2f3cc076-8153-4b84-b7c3-bb3071c35a3a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:19.678060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f3cc076-8153-4b84-b7c3-bb3071c35a3a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:19.678205 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f3cc076-8153-4b84-b7c3-bb3071c35a3a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:19.678507 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f3cc076-8153-4b84-b7c3-bb3071c35a3a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:19.679199 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f3cc076-8153-4b84-b7c3-bb3071c35a3a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:19.679644 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f3cc076-8153-4b84-b7c3-bb3071c35a3a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:19.680091 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f3cc076-8153-4b84-b7c3-bb3071c35a3a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:19.831278 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2f3cc076-8153-4b84-b7c3-bb3071c35a3a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:19.845043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2f3cc076-8153-4b84-b7c3-bb3071c35a3a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.178729 Aug 26 15:51:19.845767 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 95/184] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:19 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:20.876696 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e464d53f-3894-49b2-9bb2-a7ee3d505bdf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:20.877329 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e464d53f-3894-49b2-9bb2-a7ee3d505bdf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:20.884126 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e464d53f-3894-49b2-9bb2-a7ee3d505bdf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:20.884614 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e464d53f-3894-49b2-9bb2-a7ee3d505bdf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:20.885057 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e464d53f-3894-49b2-9bb2-a7ee3d505bdf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:20.885764 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e464d53f-3894-49b2-9bb2-a7ee3d505bdf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:20.886219 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e464d53f-3894-49b2-9bb2-a7ee3d505bdf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:20.886641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e464d53f-3894-49b2-9bb2-a7ee3d505bdf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:21.014872 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e464d53f-3894-49b2-9bb2-a7ee3d505bdf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:21.023057 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e464d53f-3894-49b2-9bb2-a7ee3d505bdf tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.152207 Aug 26 15:51:21.023746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 90/185] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:20 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:22.044836 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f373a9fe-7e03-4a96-9166-3fb4b8ecb50f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:22.045455 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f373a9fe-7e03-4a96-9166-3fb4b8ecb50f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:22.052112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f373a9fe-7e03-4a96-9166-3fb4b8ecb50f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:22.052611 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f373a9fe-7e03-4a96-9166-3fb4b8ecb50f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:22.053048 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f373a9fe-7e03-4a96-9166-3fb4b8ecb50f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:22.053736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f373a9fe-7e03-4a96-9166-3fb4b8ecb50f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:22.054192 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f373a9fe-7e03-4a96-9166-3fb4b8ecb50f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:22.054718 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f373a9fe-7e03-4a96-9166-3fb4b8ecb50f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:22.195704 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f373a9fe-7e03-4a96-9166-3fb4b8ecb50f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:22.204477 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f373a9fe-7e03-4a96-9166-3fb4b8ecb50f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.163342 Aug 26 15:51:22.205117 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 96/186] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:22 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:23.225191 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b9dbb76c-bcec-46b0-b35e-662801fc1ed4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:23.225861 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b9dbb76c-bcec-46b0-b35e-662801fc1ed4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:23.237087 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9dbb76c-bcec-46b0-b35e-662801fc1ed4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:23.237584 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9dbb76c-bcec-46b0-b35e-662801fc1ed4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:23.238436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9dbb76c-bcec-46b0-b35e-662801fc1ed4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:23.239021 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9dbb76c-bcec-46b0-b35e-662801fc1ed4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:23.239704 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9dbb76c-bcec-46b0-b35e-662801fc1ed4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:23.240192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9dbb76c-bcec-46b0-b35e-662801fc1ed4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:23.384617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b9dbb76c-bcec-46b0-b35e-662801fc1ed4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:23.397515 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b9dbb76c-bcec-46b0-b35e-662801fc1ed4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.176208 Aug 26 15:51:23.398102 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 91/187] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:23 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:24.420003 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a4e273d6-f293-411b-a186-4893c2555c0a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:24.420625 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a4e273d6-f293-411b-a186-4893c2555c0a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:24.426914 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a4e273d6-f293-411b-a186-4893c2555c0a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:24.427402 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a4e273d6-f293-411b-a186-4893c2555c0a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:24.427838 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a4e273d6-f293-411b-a186-4893c2555c0a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:24.428559 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a4e273d6-f293-411b-a186-4893c2555c0a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:24.429007 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a4e273d6-f293-411b-a186-4893c2555c0a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:24.429427 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a4e273d6-f293-411b-a186-4893c2555c0a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:24.584954 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-a4e273d6-f293-411b-a186-4893c2555c0a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:24.594826 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-a4e273d6-f293-411b-a186-4893c2555c0a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.178328 Aug 26 15:51:24.595687 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 97/188] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:24 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:25.622035 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-3a4db663-d397-405a-964d-47f42c89ea17 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:25.623412 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-3a4db663-d397-405a-964d-47f42c89ea17 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:25.633106 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3a4db663-d397-405a-964d-47f42c89ea17 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:25.633741 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3a4db663-d397-405a-964d-47f42c89ea17 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:25.634395 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3a4db663-d397-405a-964d-47f42c89ea17 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:25.635340 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3a4db663-d397-405a-964d-47f42c89ea17 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:25.636202 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3a4db663-d397-405a-964d-47f42c89ea17 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:25.637746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3a4db663-d397-405a-964d-47f42c89ea17 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:25.701498 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e6666987-4cfd-47b3-b51e-9b30fbceb35b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:25.703252 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e6666987-4cfd-47b3-b51e-9b30fbceb35b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:25.711063 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e6666987-4cfd-47b3-b51e-9b30fbceb35b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:25.712036 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e6666987-4cfd-47b3-b51e-9b30fbceb35b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:25.712985 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e6666987-4cfd-47b3-b51e-9b30fbceb35b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:25.714789 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e6666987-4cfd-47b3-b51e-9b30fbceb35b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:25.715507 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e6666987-4cfd-47b3-b51e-9b30fbceb35b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:25.716225 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e6666987-4cfd-47b3-b51e-9b30fbceb35b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:25.780137 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e6666987-4cfd-47b3-b51e-9b30fbceb35b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Going to try to terminate instance {{(pid=127698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:51:25.808883 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-3a4db663-d397-405a-964d-47f42c89ea17 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:25.821206 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-3a4db663-d397-405a-964d-47f42c89ea17 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.203980 Aug 26 15:51:25.821873 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 92/189] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:25 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:25.834629 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:26.262525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e6666987-4cfd-47b3-b51e-9b30fbceb35b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 204 len: 0 microversion: 2.1 time: 0.567281 Aug 26 15:51:26.263218 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 98/190] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:51:25 2022] DELETE /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 15:51:26.273672 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-13208b78-0fb4-4198-8779-6c77b55169e1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:26.274331 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-13208b78-0fb4-4198-8779-6c77b55169e1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:26.281480 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-13208b78-0fb4-4198-8779-6c77b55169e1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:26.281977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-13208b78-0fb4-4198-8779-6c77b55169e1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:26.282455 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-13208b78-0fb4-4198-8779-6c77b55169e1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:26.283117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-13208b78-0fb4-4198-8779-6c77b55169e1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:26.283579 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-13208b78-0fb4-4198-8779-6c77b55169e1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:26.284043 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-13208b78-0fb4-4198-8779-6c77b55169e1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:26.429250 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-13208b78-0fb4-4198-8779-6c77b55169e1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:26.438884 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-13208b78-0fb4-4198-8779-6c77b55169e1 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1552 microversion: 2.1 time: 0.170684 Aug 26 15:51:26.440015 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 93/191] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:26 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:26.857874 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3e99b9e9-070a-4769-9472-0c3d2ae1f25a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:26.857874 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3e99b9e9-070a-4769-9472-0c3d2ae1f25a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:26.860990 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3e99b9e9-070a-4769-9472-0c3d2ae1f25a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:26.861475 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3e99b9e9-070a-4769-9472-0c3d2ae1f25a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:26.861988 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3e99b9e9-070a-4769-9472-0c3d2ae1f25a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:26.862738 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3e99b9e9-070a-4769-9472-0c3d2ae1f25a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:26.863214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3e99b9e9-070a-4769-9472-0c3d2ae1f25a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:26.863630 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3e99b9e9-070a-4769-9472-0c3d2ae1f25a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:27.000092 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3e99b9e9-070a-4769-9472-0c3d2ae1f25a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:27.011729 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3e99b9e9-070a-4769-9472-0c3d2ae1f25a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.170797 Aug 26 15:51:27.013809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 99/192] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:26 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:27.476952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f5462445-24ae-4c91-a203-dba47f3688cb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:27.478632 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f5462445-24ae-4c91-a203-dba47f3688cb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:27.488638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f5462445-24ae-4c91-a203-dba47f3688cb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:27.494211 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f5462445-24ae-4c91-a203-dba47f3688cb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:27.494211 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f5462445-24ae-4c91-a203-dba47f3688cb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:27.494211 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f5462445-24ae-4c91-a203-dba47f3688cb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:27.494211 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f5462445-24ae-4c91-a203-dba47f3688cb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:27.494568 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f5462445-24ae-4c91-a203-dba47f3688cb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:27.651933 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f5462445-24ae-4c91-a203-dba47f3688cb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:27.661163 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f5462445-24ae-4c91-a203-dba47f3688cb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1552 microversion: 2.1 time: 0.189626 Aug 26 15:51:27.664569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 94/193] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:27 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1552 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:28.033501 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c61a757b-d9ff-4a55-9e56-a3aaa91796d9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:28.034110 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c61a757b-d9ff-4a55-9e56-a3aaa91796d9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:28.040625 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c61a757b-d9ff-4a55-9e56-a3aaa91796d9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:28.041118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c61a757b-d9ff-4a55-9e56-a3aaa91796d9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:28.041545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c61a757b-d9ff-4a55-9e56-a3aaa91796d9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:28.042242 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c61a757b-d9ff-4a55-9e56-a3aaa91796d9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:28.042699 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c61a757b-d9ff-4a55-9e56-a3aaa91796d9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:28.043167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c61a757b-d9ff-4a55-9e56-a3aaa91796d9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:28.176052 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c61a757b-d9ff-4a55-9e56-a3aaa91796d9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:28.183809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c61a757b-d9ff-4a55-9e56-a3aaa91796d9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.154250 Aug 26 15:51:28.184413 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 100/194] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:28 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:28.685930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0118ba7d-3b90-4cef-a854-fc4fa9cedb6e tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:28.686752 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0118ba7d-3b90-4cef-a854-fc4fa9cedb6e tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:28.694272 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0118ba7d-3b90-4cef-a854-fc4fa9cedb6e tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:28.697006 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0118ba7d-3b90-4cef-a854-fc4fa9cedb6e tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:28.697006 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0118ba7d-3b90-4cef-a854-fc4fa9cedb6e tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:28.697006 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0118ba7d-3b90-4cef-a854-fc4fa9cedb6e tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:28.697006 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0118ba7d-3b90-4cef-a854-fc4fa9cedb6e tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:28.697322 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0118ba7d-3b90-4cef-a854-fc4fa9cedb6e tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:28.963996 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0118ba7d-3b90-4cef-a854-fc4fa9cedb6e tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:28.967779 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:28.974862 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0118ba7d-3b90-4cef-a854-fc4fa9cedb6e tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1552 microversion: 2.1 time: 0.294133 Aug 26 15:51:28.975971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 95/195] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:28 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1552 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:29.208574 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-320f0e00-851b-411b-a0ab-7b7b367a3317 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:29.209311 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-320f0e00-851b-411b-a0ab-7b7b367a3317 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:29.219127 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-320f0e00-851b-411b-a0ab-7b7b367a3317 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:29.224752 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-320f0e00-851b-411b-a0ab-7b7b367a3317 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:29.226866 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-320f0e00-851b-411b-a0ab-7b7b367a3317 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:29.227750 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-320f0e00-851b-411b-a0ab-7b7b367a3317 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:29.229851 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-320f0e00-851b-411b-a0ab-7b7b367a3317 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:29.230774 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-320f0e00-851b-411b-a0ab-7b7b367a3317 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:29.406052 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-320f0e00-851b-411b-a0ab-7b7b367a3317 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:29.417017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-320f0e00-851b-411b-a0ab-7b7b367a3317 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.215457 Aug 26 15:51:29.430579 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 101/196] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:29 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:29.874346 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-33d6f5d8-c087-4247-bd75-3c8d1e33c3fc req-30b66c1c-7e0c-4663-92e9-d66bbcf4c815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff835f8-1f60-42e7-b12f-bb08724decc6", "name": "network-vif-deleted", "tag": "4b02b745-e421-4c5a-bf2a-85638bcc6243"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:51:29.886372 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-33d6f5d8-c087-4247-bd75-3c8d1e33c3fc req-30b66c1c-7e0c-4663-92e9-d66bbcf4c815 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:29.886886 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-33d6f5d8-c087-4247-bd75-3c8d1e33c3fc req-30b66c1c-7e0c-4663-92e9-d66bbcf4c815 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:29.887291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-33d6f5d8-c087-4247-bd75-3c8d1e33c3fc req-30b66c1c-7e0c-4663-92e9-d66bbcf4c815 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:29.909990 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-33d6f5d8-c087-4247-bd75-3c8d1e33c3fc req-30b66c1c-7e0c-4663-92e9-d66bbcf4c815 service nova] Creating event network-vif-deleted:4b02b745-e421-4c5a-bf2a-85638bcc6243 for instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 on hv-cinder-83124 Aug 26 15:51:29.915515 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-33d6f5d8-c087-4247-bd75-3c8d1e33c3fc req-30b66c1c-7e0c-4663-92e9-d66bbcf4c815 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044740 Aug 26 15:51:29.916170 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 96/197] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:51:29.996419 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-da9dd051-c737-463b-8ad7-e0b47684efcf tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:29.997052 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-da9dd051-c737-463b-8ad7-e0b47684efcf tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:30.004081 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-da9dd051-c737-463b-8ad7-e0b47684efcf tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:30.004081 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-da9dd051-c737-463b-8ad7-e0b47684efcf tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:30.004081 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-da9dd051-c737-463b-8ad7-e0b47684efcf tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:30.004799 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-da9dd051-c737-463b-8ad7-e0b47684efcf tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:30.005244 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-da9dd051-c737-463b-8ad7-e0b47684efcf tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:30.005655 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-da9dd051-c737-463b-8ad7-e0b47684efcf tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:30.075091 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-da9dd051-c737-463b-8ad7-e0b47684efcf tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:30.085197 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-da9dd051-c737-463b-8ad7-e0b47684efcf tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1510 microversion: 2.1 time: 0.093153 Aug 26 15:51:30.086299 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 102/198] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:29 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1510 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:30.439963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-67bef3f9-83b2-4f05-b37c-a6a113e41980 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:30.440860 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-67bef3f9-83b2-4f05-b37c-a6a113e41980 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:30.447969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-67bef3f9-83b2-4f05-b37c-a6a113e41980 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:30.448558 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-67bef3f9-83b2-4f05-b37c-a6a113e41980 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:30.449102 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-67bef3f9-83b2-4f05-b37c-a6a113e41980 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:30.450387 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-67bef3f9-83b2-4f05-b37c-a6a113e41980 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:30.450933 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-67bef3f9-83b2-4f05-b37c-a6a113e41980 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:30.451437 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-67bef3f9-83b2-4f05-b37c-a6a113e41980 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:30.640622 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-67bef3f9-83b2-4f05-b37c-a6a113e41980 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:30.649296 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-67bef3f9-83b2-4f05-b37c-a6a113e41980 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.214832 Aug 26 15:51:30.650226 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 97/199] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:30 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:31.106952 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e60d26f9-1a82-4672-bac6-cc0b4df12bae tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:31.107705 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e60d26f9-1a82-4672-bac6-cc0b4df12bae tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:31.114925 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e60d26f9-1a82-4672-bac6-cc0b4df12bae tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:31.115414 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e60d26f9-1a82-4672-bac6-cc0b4df12bae tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:31.115849 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e60d26f9-1a82-4672-bac6-cc0b4df12bae tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:31.116628 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e60d26f9-1a82-4672-bac6-cc0b4df12bae tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:31.117086 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e60d26f9-1a82-4672-bac6-cc0b4df12bae tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:31.117509 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e60d26f9-1a82-4672-bac6-cc0b4df12bae tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:31.194734 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e60d26f9-1a82-4672-bac6-cc0b4df12bae tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:31.204323 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e60d26f9-1a82-4672-bac6-cc0b4df12bae tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1345 microversion: 2.1 time: 0.101478 Aug 26 15:51:31.207503 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 103/200] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:31 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:31.674429 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0bc7daaf-c7c6-45df-9238-f6bb0b0a2e6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:31.675165 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0bc7daaf-c7c6-45df-9238-f6bb0b0a2e6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:31.682305 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0bc7daaf-c7c6-45df-9238-f6bb0b0a2e6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:31.682902 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0bc7daaf-c7c6-45df-9238-f6bb0b0a2e6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:31.683404 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0bc7daaf-c7c6-45df-9238-f6bb0b0a2e6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:31.684204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0bc7daaf-c7c6-45df-9238-f6bb0b0a2e6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:31.684724 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0bc7daaf-c7c6-45df-9238-f6bb0b0a2e6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:31.685213 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0bc7daaf-c7c6-45df-9238-f6bb0b0a2e6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:31.850866 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0bc7daaf-c7c6-45df-9238-f6bb0b0a2e6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:31.863351 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0bc7daaf-c7c6-45df-9238-f6bb0b0a2e6f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.196490 Aug 26 15:51:31.864338 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 98/201] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:31 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:51:32.229136 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-6793d5c1-ee43-4911-b8f2-27a0e867297b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:32.229740 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-6793d5c1-ee43-4911-b8f2-27a0e867297b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:32.242983 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6793d5c1-ee43-4911-b8f2-27a0e867297b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:32.243539 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6793d5c1-ee43-4911-b8f2-27a0e867297b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:32.244013 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6793d5c1-ee43-4911-b8f2-27a0e867297b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:32.244738 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6793d5c1-ee43-4911-b8f2-27a0e867297b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:32.245193 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6793d5c1-ee43-4911-b8f2-27a0e867297b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:32.245649 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6793d5c1-ee43-4911-b8f2-27a0e867297b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:32.278895 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6793d5c1-ee43-4911-b8f2-27a0e867297b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:32.279356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6793d5c1-ee43-4911-b8f2-27a0e867297b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:32.279784 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6793d5c1-ee43-4911-b8f2-27a0e867297b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:32.280265 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-6793d5c1-ee43-4911-b8f2-27a0e867297b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lazy-loading 'fault' on Instance uuid 9ff835f8-1f60-42e7-b12f-bb08724decc6 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:51:32.324397 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-6793d5c1-ee43-4911-b8f2-27a0e867297b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:32.333247 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-6793d5c1-ee43-4911-b8f2-27a0e867297b tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1350 microversion: 2.1 time: 0.107948 Aug 26 15:51:32.333969 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 104/202] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:32 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:32.890839 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-146e08a9-99b6-4ee0-80b4-d228a69597c2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:32.893392 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-146e08a9-99b6-4ee0-80b4-d228a69597c2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:32.900290 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-146e08a9-99b6-4ee0-80b4-d228a69597c2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:32.900828 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-146e08a9-99b6-4ee0-80b4-d228a69597c2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:32.901207 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-146e08a9-99b6-4ee0-80b4-d228a69597c2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:32.901936 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-146e08a9-99b6-4ee0-80b4-d228a69597c2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:32.902362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-146e08a9-99b6-4ee0-80b4-d228a69597c2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:32.902783 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-146e08a9-99b6-4ee0-80b4-d228a69597c2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:33.049302 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-146e08a9-99b6-4ee0-80b4-d228a69597c2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:33.058137 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-146e08a9-99b6-4ee0-80b4-d228a69597c2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.176694 Aug 26 15:51:33.060191 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 99/203] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:32 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:33.355853 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-64bc8877-deeb-467d-a2fc-976de712395c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:33.356523 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-64bc8877-deeb-467d-a2fc-976de712395c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:33.363125 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64bc8877-deeb-467d-a2fc-976de712395c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:33.363629 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64bc8877-deeb-467d-a2fc-976de712395c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:33.364108 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64bc8877-deeb-467d-a2fc-976de712395c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:33.364782 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64bc8877-deeb-467d-a2fc-976de712395c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:33.365227 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64bc8877-deeb-467d-a2fc-976de712395c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:33.365645 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64bc8877-deeb-467d-a2fc-976de712395c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:33.399170 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64bc8877-deeb-467d-a2fc-976de712395c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:33.399651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64bc8877-deeb-467d-a2fc-976de712395c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:33.400161 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64bc8877-deeb-467d-a2fc-976de712395c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:33.402781 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-64bc8877-deeb-467d-a2fc-976de712395c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lazy-loading 'fault' on Instance uuid 9ff835f8-1f60-42e7-b12f-bb08724decc6 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:51:33.456597 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-64bc8877-deeb-467d-a2fc-976de712395c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:33.472574 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-64bc8877-deeb-467d-a2fc-976de712395c tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1350 microversion: 2.1 time: 0.121804 Aug 26 15:51:33.473180 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 105/204] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:33 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:34.084390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-8a604b55-c9e3-4820-a2d1-c513d884287f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:34.085354 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-8a604b55-c9e3-4820-a2d1-c513d884287f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:34.091930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8a604b55-c9e3-4820-a2d1-c513d884287f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:34.092424 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8a604b55-c9e3-4820-a2d1-c513d884287f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:34.092862 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8a604b55-c9e3-4820-a2d1-c513d884287f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:34.093656 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8a604b55-c9e3-4820-a2d1-c513d884287f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:34.094111 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8a604b55-c9e3-4820-a2d1-c513d884287f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:34.094569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8a604b55-c9e3-4820-a2d1-c513d884287f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:34.235618 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-8a604b55-c9e3-4820-a2d1-c513d884287f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:34.243652 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-8a604b55-c9e3-4820-a2d1-c513d884287f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.163273 Aug 26 15:51:34.244759 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 100/205] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:34 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:34.494419 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-07b48677-891c-443e-8973-a4fd9ea231bb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:34.503133 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-07b48677-891c-443e-8973-a4fd9ea231bb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:34.503133 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07b48677-891c-443e-8973-a4fd9ea231bb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:34.503133 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07b48677-891c-443e-8973-a4fd9ea231bb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:34.503133 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07b48677-891c-443e-8973-a4fd9ea231bb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:34.504017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07b48677-891c-443e-8973-a4fd9ea231bb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:34.504017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07b48677-891c-443e-8973-a4fd9ea231bb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:34.504017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07b48677-891c-443e-8973-a4fd9ea231bb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:34.534420 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07b48677-891c-443e-8973-a4fd9ea231bb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:34.534890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07b48677-891c-443e-8973-a4fd9ea231bb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:34.535338 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07b48677-891c-443e-8973-a4fd9ea231bb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:34.535759 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-07b48677-891c-443e-8973-a4fd9ea231bb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lazy-loading 'fault' on Instance uuid 9ff835f8-1f60-42e7-b12f-bb08724decc6 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:51:34.580170 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-07b48677-891c-443e-8973-a4fd9ea231bb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:34.596540 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-07b48677-891c-443e-8973-a4fd9ea231bb tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1350 microversion: 2.1 time: 0.106070 Aug 26 15:51:34.597452 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 106/206] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:34 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:35.271484 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1e837b3b-684d-42f2-9671-1f94f6d812c9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:35.272121 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1e837b3b-684d-42f2-9671-1f94f6d812c9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:35.278760 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1e837b3b-684d-42f2-9671-1f94f6d812c9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:35.279424 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1e837b3b-684d-42f2-9671-1f94f6d812c9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:35.279891 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1e837b3b-684d-42f2-9671-1f94f6d812c9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:35.280600 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1e837b3b-684d-42f2-9671-1f94f6d812c9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:35.281054 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1e837b3b-684d-42f2-9671-1f94f6d812c9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:35.281480 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1e837b3b-684d-42f2-9671-1f94f6d812c9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:35.424724 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1e837b3b-684d-42f2-9671-1f94f6d812c9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:35.432718 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1e837b3b-684d-42f2-9671-1f94f6d812c9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1522 microversion: 2.1 time: 0.165188 Aug 26 15:51:35.433300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 101/207] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:35 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:35.620454 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-25677ec3-b7ef-4a7c-9145-afb4a49f95ab tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:35.621135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-25677ec3-b7ef-4a7c-9145-afb4a49f95ab tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:35.628783 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-25677ec3-b7ef-4a7c-9145-afb4a49f95ab tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:35.629585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-25677ec3-b7ef-4a7c-9145-afb4a49f95ab tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:35.630024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-25677ec3-b7ef-4a7c-9145-afb4a49f95ab tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:35.630739 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-25677ec3-b7ef-4a7c-9145-afb4a49f95ab tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:35.632706 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-25677ec3-b7ef-4a7c-9145-afb4a49f95ab tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:35.632706 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-25677ec3-b7ef-4a7c-9145-afb4a49f95ab tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:35.667757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-25677ec3-b7ef-4a7c-9145-afb4a49f95ab tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:35.668268 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-25677ec3-b7ef-4a7c-9145-afb4a49f95ab tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:35.668703 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-25677ec3-b7ef-4a7c-9145-afb4a49f95ab tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:35.669153 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-25677ec3-b7ef-4a7c-9145-afb4a49f95ab tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lazy-loading 'fault' on Instance uuid 9ff835f8-1f60-42e7-b12f-bb08724decc6 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:51:35.712253 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-25677ec3-b7ef-4a7c-9145-afb4a49f95ab tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dc0c14d61e4bae9aaa31bf46cb1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ef4da23ec44ed2a75e20f8cd365691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:35.720536 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-25677ec3-b7ef-4a7c-9145-afb4a49f95ab tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 200 len: 1350 microversion: 2.1 time: 0.103913 Aug 26 15:51:35.721066 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 107/208] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:35 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:36.455118 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9a7ab383-e2b1-4ddb-80ce-f3ed44b25453 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:36.456175 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9a7ab383-e2b1-4ddb-80ce-f3ed44b25453 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:36.462688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9a7ab383-e2b1-4ddb-80ce-f3ed44b25453 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:36.464700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9a7ab383-e2b1-4ddb-80ce-f3ed44b25453 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:36.464700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9a7ab383-e2b1-4ddb-80ce-f3ed44b25453 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:36.464700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9a7ab383-e2b1-4ddb-80ce-f3ed44b25453 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:36.464958 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9a7ab383-e2b1-4ddb-80ce-f3ed44b25453 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:36.465218 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9a7ab383-e2b1-4ddb-80ce-f3ed44b25453 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:36.619832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9a7ab383-e2b1-4ddb-80ce-f3ed44b25453 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:36.627978 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9a7ab383-e2b1-4ddb-80ce-f3ed44b25453 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1502 microversion: 2.1 time: 0.177240 Aug 26 15:51:36.628650 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 102/209] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:36 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:36.650611 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-6c7abc09-e772-4a51-b329-5adc245e9181 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:36.651215 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-6c7abc09-e772-4a51-b329-5adc245e9181 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:36.662138 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6c7abc09-e772-4a51-b329-5adc245e9181 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:36.662625 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6c7abc09-e772-4a51-b329-5adc245e9181 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:36.663059 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6c7abc09-e772-4a51-b329-5adc245e9181 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:36.663779 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6c7abc09-e772-4a51-b329-5adc245e9181 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:36.664306 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6c7abc09-e772-4a51-b329-5adc245e9181 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:36.666272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6c7abc09-e772-4a51-b329-5adc245e9181 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:36.741985 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c4799a42-330f-4eef-921c-c874e73ad7a2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:36.743019 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c4799a42-330f-4eef-921c-c874e73ad7a2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:36.749543 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c4799a42-330f-4eef-921c-c874e73ad7a2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:36.750033 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c4799a42-330f-4eef-921c-c874e73ad7a2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:36.750464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c4799a42-330f-4eef-921c-c874e73ad7a2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:36.751567 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c4799a42-330f-4eef-921c-c874e73ad7a2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:36.752248 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c4799a42-330f-4eef-921c-c874e73ad7a2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:36.752888 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c4799a42-330f-4eef-921c-c874e73ad7a2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:36.775502 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-c4799a42-330f-4eef-921c-c874e73ad7a2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] HTTP exception thrown: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c4799a42-330f-4eef-921c-c874e73ad7a2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Request method failure captured: Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 HTTP/1.1 Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOu5B2FF5cm8GGy7wf0bzklNId4RDhnGE6BKVsU3cHQOsZ2agHo3GJ2XmU3JRfQXdfTXz8cHp9Js8sRgK-meGpjK92tbwVefIIOQ9V0B0R9hNaz2_NPDMcmLVHEX4f3Hd0Z-9efVyv6Sg7afmGZugUZikqnsIKC0gsJjbsGls1zN2Ns Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: 35ef4da23ec44ed2a75e20f8cd365691 Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-DeleteServersTestJSON-194666870 Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:51:36.781022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:51:36.782284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/35ef4da23ec44ed2a75e20f8cd365691"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_35ef4da23ec44ed2a75e20f8cd365691", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/35ef4da23ec44ed2a75e20f8cd365691"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/35ef4da23ec44ed2a75e20f8cd365691"}]}] Aug 26 15:51:36.782284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-DeleteServersTestJSON-194666870 Aug 26 15:51:36.782284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: 35ef4da23ec44ed2a75e20f8cd365691 Aug 26 15:51:36.782284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-DeleteServersTestJSON-194666870 Aug 26 15:51:36.782284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-DeleteServersTestJSON-194666870-project Aug 26 15:51:36.782284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:51:36.782284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:51:36.782284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 72dc0c14d61e4bae9aaa31bf46cb1e08 Aug 26 15:51:36.782284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-DeleteServersTestJSON-194666870-project Aug 26 15:51:36.782284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:51:36.782284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:36.782284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '9ff835f8-1f60-42e7-b12f-bb08724decc6'} Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:51:36.782963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:36.784504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:36.787005 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c4799a42-330f-4eef-921c-c874e73ad7a2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Returning 404 to user: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:51:36.787928 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c4799a42-330f-4eef-921c-c874e73ad7a2 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 404 len: 111 microversion: 2.1 time: 0.050517 Aug 26 15:51:36.788456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 103/210] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:36 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 15:51:36.822648 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-6c7abc09-e772-4a51-b329-5adc245e9181 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:36.830262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-6c7abc09-e772-4a51-b329-5adc245e9181 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1515 microversion: 2.1 time: 0.183775 Aug 26 15:51:36.830836 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 108/211] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:36 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:37.365373 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-eaa962da-8f78-433b-824e-1522c01854c6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:37.368433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-eaa962da-8f78-433b-824e-1522c01854c6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:37.376500 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-eaa962da-8f78-433b-824e-1522c01854c6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:37.377142 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-eaa962da-8f78-433b-824e-1522c01854c6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:37.377581 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-eaa962da-8f78-433b-824e-1522c01854c6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:37.378502 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-eaa962da-8f78-433b-824e-1522c01854c6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:37.378928 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-eaa962da-8f78-433b-824e-1522c01854c6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:37.379448 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-eaa962da-8f78-433b-824e-1522c01854c6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:37.393769 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-eaa962da-8f78-433b-824e-1522c01854c6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] HTTP exception thrown: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-eaa962da-8f78-433b-824e-1522c01854c6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Request method failure captured: Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6/os-volume_attachments HTTP/1.1 Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOu5B2FF5cm8GGy7wf0bzklNId4RDhnGE6BKVsU3cHQOsZ2agHo3GJ2XmU3JRfQXdfTXz8cHp9Js8sRgK-meGpjK92tbwVefIIOQ9V0B0R9hNaz2_NPDMcmLVHEX4f3Hd0Z-9efVyv6Sg7afmGZugUZikqnsIKC0gsJjbsGls1zN2Ns Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: 35ef4da23ec44ed2a75e20f8cd365691 Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-DeleteServersTestJSON-194666870 Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:51:37.395308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:51:37.396785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/35ef4da23ec44ed2a75e20f8cd365691"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_35ef4da23ec44ed2a75e20f8cd365691", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/35ef4da23ec44ed2a75e20f8cd365691"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/35ef4da23ec44ed2a75e20f8cd365691"}]}] Aug 26 15:51:37.396785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-DeleteServersTestJSON-194666870 Aug 26 15:51:37.396785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: 35ef4da23ec44ed2a75e20f8cd365691 Aug 26 15:51:37.396785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-DeleteServersTestJSON-194666870 Aug 26 15:51:37.396785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-DeleteServersTestJSON-194666870-project Aug 26 15:51:37.396785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:51:37.396785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:51:37.396785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 72dc0c14d61e4bae9aaa31bf46cb1e08 Aug 26 15:51:37.396785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-DeleteServersTestJSON-194666870-project Aug 26 15:51:37.396785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:51:37.396785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:37.396785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'server_id': '9ff835f8-1f60-42e7-b12f-bb08724decc6'} Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:51:37.397674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:37.398795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:37.399857 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-eaa962da-8f78-433b-824e-1522c01854c6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Returning 404 to user: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:51:37.399857 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-eaa962da-8f78-433b-824e-1522c01854c6 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035728 Aug 26 15:51:37.399857 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 104/212] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:51:37 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 15:51:39.462880 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-07a7ed70-b908-4817-936c-322624b74149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:51:39.465931 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-07a7ed70-b908-4817-936c-322624b74149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:39.472529 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07a7ed70-b908-4817-936c-322624b74149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:39.473018 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07a7ed70-b908-4817-936c-322624b74149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:39.473456 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07a7ed70-b908-4817-936c-322624b74149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:39.474316 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07a7ed70-b908-4817-936c-322624b74149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:39.474834 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07a7ed70-b908-4817-936c-322624b74149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:39.475208 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07a7ed70-b908-4817-936c-322624b74149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:39.500921 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-07a7ed70-b908-4817-936c-322624b74149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lazy-loading 'flavor' on Instance uuid eae5c9c4-de22-4f03-a66b-3b0a632131e0 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:51:39.934872 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-07a7ed70-b908-4817-936c-322624b74149 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "POST /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0/action" status: 200 len: 32 microversion: 2.1 time: 0.475818 Aug 26 15:51:39.944530 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 109/213] 10.222.0.98 () {60 vars in 1278 bytes} [Fri Aug 26 15:51:39 2022] POST /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0/action => generated 32 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 15:51:39.957863 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-fd18ebe8-3f62-4704-b523-313724b6761e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:39.959368 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-fd18ebe8-3f62-4704-b523-313724b6761e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:39.969507 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fd18ebe8-3f62-4704-b523-313724b6761e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:39.975718 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fd18ebe8-3f62-4704-b523-313724b6761e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:39.975718 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fd18ebe8-3f62-4704-b523-313724b6761e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:39.975718 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fd18ebe8-3f62-4704-b523-313724b6761e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:39.975718 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fd18ebe8-3f62-4704-b523-313724b6761e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:39.976167 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fd18ebe8-3f62-4704-b523-313724b6761e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:40.263501 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-fd18ebe8-3f62-4704-b523-313724b6761e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:40.274510 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-fd18ebe8-3f62-4704-b523-313724b6761e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.323925 Aug 26 15:51:40.275090 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 105/214] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:39 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:40.790262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-240b11b5-6fde-469d-8c21-04953f08eb32 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:40.791354 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-240b11b5-6fde-469d-8c21-04953f08eb32 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:40.801117 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-240b11b5-6fde-469d-8c21-04953f08eb32 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:40.802061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-240b11b5-6fde-469d-8c21-04953f08eb32 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:40.803022 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-240b11b5-6fde-469d-8c21-04953f08eb32 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:40.804222 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-240b11b5-6fde-469d-8c21-04953f08eb32 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:40.805018 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-240b11b5-6fde-469d-8c21-04953f08eb32 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:40.805704 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-240b11b5-6fde-469d-8c21-04953f08eb32 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:40.833306 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-240b11b5-6fde-469d-8c21-04953f08eb32 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] HTTP exception thrown: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-240b11b5-6fde-469d-8c21-04953f08eb32 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Request method failure captured: Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: DELETE /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 HTTP/1.1 Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOu5B2FF5cm8GGy7wf0bzklNId4RDhnGE6BKVsU3cHQOsZ2agHo3GJ2XmU3JRfQXdfTXz8cHp9Js8sRgK-meGpjK92tbwVefIIOQ9V0B0R9hNaz2_NPDMcmLVHEX4f3Hd0Z-9efVyv6Sg7afmGZugUZikqnsIKC0gsJjbsGls1zN2Ns Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: 35ef4da23ec44ed2a75e20f8cd365691 Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-DeleteServersTestJSON-194666870 Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:51:40.841236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:51:40.842588 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/35ef4da23ec44ed2a75e20f8cd365691"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_35ef4da23ec44ed2a75e20f8cd365691", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/35ef4da23ec44ed2a75e20f8cd365691"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/35ef4da23ec44ed2a75e20f8cd365691"}]}] Aug 26 15:51:40.842588 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-DeleteServersTestJSON-194666870 Aug 26 15:51:40.842588 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: 35ef4da23ec44ed2a75e20f8cd365691 Aug 26 15:51:40.842588 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-DeleteServersTestJSON-194666870 Aug 26 15:51:40.842588 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-DeleteServersTestJSON-194666870-project Aug 26 15:51:40.842588 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:51:40.842588 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:51:40.842588 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 72dc0c14d61e4bae9aaa31bf46cb1e08 Aug 26 15:51:40.842588 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-DeleteServersTestJSON-194666870-project Aug 26 15:51:40.842588 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:51:40.842588 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:40.842588 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '9ff835f8-1f60-42e7-b12f-bb08724decc6'} Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:51:40.844017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:40.845167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:51:40.846344 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-240b11b5-6fde-469d-8c21-04953f08eb32 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Returning 404 to user: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:51:40.848687 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-240b11b5-6fde-469d-8c21-04953f08eb32 tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 404 len: 111 microversion: 2.1 time: 0.062777 Aug 26 15:51:40.849894 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 110/215] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:51:40 2022] DELETE /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:51:40.857803 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0ccc1dc1-c766-4a5a-aa87-1d0a173c85db tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:40.858381 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0ccc1dc1-c766-4a5a-aa87-1d0a173c85db tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] [instance: 9ff835f8-1f60-42e7-b12f-bb08724decc6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:40.870708 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ccc1dc1-c766-4a5a-aa87-1d0a173c85db tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:40.874417 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ccc1dc1-c766-4a5a-aa87-1d0a173c85db tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:40.874417 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ccc1dc1-c766-4a5a-aa87-1d0a173c85db tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:40.891043 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ccc1dc1-c766-4a5a-aa87-1d0a173c85db tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:40.899689 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ccc1dc1-c766-4a5a-aa87-1d0a173c85db tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:40.900275 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ccc1dc1-c766-4a5a-aa87-1d0a173c85db tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:40.930816 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-0ccc1dc1-c766-4a5a-aa87-1d0a173c85db tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] HTTP exception thrown: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0ccc1dc1-c766-4a5a-aa87-1d0a173c85db tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Request method failure captured: Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 HTTP/1.1 Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOu5B2FF5cm8GGy7wf0bzklNId4RDhnGE6BKVsU3cHQOsZ2agHo3GJ2XmU3JRfQXdfTXz8cHp9Js8sRgK-meGpjK92tbwVefIIOQ9V0B0R9hNaz2_NPDMcmLVHEX4f3Hd0Z-9efVyv6Sg7afmGZugUZikqnsIKC0gsJjbsGls1zN2Ns Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: 35ef4da23ec44ed2a75e20f8cd365691 Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-DeleteServersTestJSON-194666870 Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:51:40.937227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:51:40.938729 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/35ef4da23ec44ed2a75e20f8cd365691"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_35ef4da23ec44ed2a75e20f8cd365691", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/35ef4da23ec44ed2a75e20f8cd365691"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/35ef4da23ec44ed2a75e20f8cd365691"}]}] Aug 26 15:51:40.938729 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-DeleteServersTestJSON-194666870 Aug 26 15:51:40.938729 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: 35ef4da23ec44ed2a75e20f8cd365691 Aug 26 15:51:40.938729 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-DeleteServersTestJSON-194666870 Aug 26 15:51:40.938729 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-DeleteServersTestJSON-194666870-project Aug 26 15:51:40.938729 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:51:40.938729 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:51:40.938729 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 72dc0c14d61e4bae9aaa31bf46cb1e08 Aug 26 15:51:40.938729 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-DeleteServersTestJSON-194666870-project Aug 26 15:51:40.938729 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:51:40.938729 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:40.938729 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '9ff835f8-1f60-42e7-b12f-bb08724decc6'} Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:51:40.939433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. Aug 26 15:51:40.940617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:40.941585 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0ccc1dc1-c766-4a5a-aa87-1d0a173c85db tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] Returning 404 to user: Instance 9ff835f8-1f60-42e7-b12f-bb08724decc6 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:51:40.941585 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0ccc1dc1-c766-4a5a-aa87-1d0a173c85db tempest-DeleteServersTestJSON-194666870 tempest-DeleteServersTestJSON-194666870-project] 10.222.0.98 "GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6" status: 404 len: 111 microversion: 2.1 time: 0.085138 Aug 26 15:51:40.941585 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 106/216] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:40 2022] GET /compute/v2.1/servers/9ff835f8-1f60-42e7-b12f-bb08724decc6 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:51:41.297860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0f233dc9-78a3-4f43-8f2c-0cb9c0f68c3f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:41.299109 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0f233dc9-78a3-4f43-8f2c-0cb9c0f68c3f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:41.306815 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f233dc9-78a3-4f43-8f2c-0cb9c0f68c3f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:41.307650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f233dc9-78a3-4f43-8f2c-0cb9c0f68c3f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:41.309803 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f233dc9-78a3-4f43-8f2c-0cb9c0f68c3f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:41.324105 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f233dc9-78a3-4f43-8f2c-0cb9c0f68c3f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:41.324105 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f233dc9-78a3-4f43-8f2c-0cb9c0f68c3f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:41.324105 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f233dc9-78a3-4f43-8f2c-0cb9c0f68c3f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:41.830680 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0f233dc9-78a3-4f43-8f2c-0cb9c0f68c3f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:41.840275 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0f233dc9-78a3-4f43-8f2c-0cb9c0f68c3f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.548721 Aug 26 15:51:41.841179 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 111/217] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:41 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:42.860578 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6df407f1-c902-4c69-a51f-765da7d630a0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:42.861195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6df407f1-c902-4c69-a51f-765da7d630a0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:42.871465 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6df407f1-c902-4c69-a51f-765da7d630a0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:42.871465 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6df407f1-c902-4c69-a51f-765da7d630a0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:42.871465 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6df407f1-c902-4c69-a51f-765da7d630a0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:42.871465 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6df407f1-c902-4c69-a51f-765da7d630a0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:42.871856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6df407f1-c902-4c69-a51f-765da7d630a0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:42.871856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6df407f1-c902-4c69-a51f-765da7d630a0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:43.447300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6df407f1-c902-4c69-a51f-765da7d630a0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:43.455993 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6df407f1-c902-4c69-a51f-765da7d630a0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.599132 Aug 26 15:51:43.471185 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 107/218] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:42 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:44.478107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-da6c0fb2-33df-4abc-bc43-578a3938ec62 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:44.478640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-da6c0fb2-33df-4abc-bc43-578a3938ec62 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:44.484591 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-da6c0fb2-33df-4abc-bc43-578a3938ec62 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:44.485066 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-da6c0fb2-33df-4abc-bc43-578a3938ec62 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:44.485487 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-da6c0fb2-33df-4abc-bc43-578a3938ec62 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:44.486166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-da6c0fb2-33df-4abc-bc43-578a3938ec62 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:44.486843 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-da6c0fb2-33df-4abc-bc43-578a3938ec62 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:44.487376 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-da6c0fb2-33df-4abc-bc43-578a3938ec62 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:44.503144 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:44.718435 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-da6c0fb2-33df-4abc-bc43-578a3938ec62 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:44.726867 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-da6c0fb2-33df-4abc-bc43-578a3938ec62 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.252537 Aug 26 15:51:44.727460 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 112/219] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:44 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:45.750171 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0350d6cb-aa52-4ae0-a3dd-9633bff09eeb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:45.750810 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0350d6cb-aa52-4ae0-a3dd-9633bff09eeb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:45.762000 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0350d6cb-aa52-4ae0-a3dd-9633bff09eeb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:45.762567 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0350d6cb-aa52-4ae0-a3dd-9633bff09eeb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:45.766469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0350d6cb-aa52-4ae0-a3dd-9633bff09eeb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:45.767338 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0350d6cb-aa52-4ae0-a3dd-9633bff09eeb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:45.767908 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0350d6cb-aa52-4ae0-a3dd-9633bff09eeb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:45.768409 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0350d6cb-aa52-4ae0-a3dd-9633bff09eeb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:46.027382 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0350d6cb-aa52-4ae0-a3dd-9633bff09eeb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:46.039314 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0350d6cb-aa52-4ae0-a3dd-9633bff09eeb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.294003 Aug 26 15:51:46.045159 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 108/220] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:45 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:47.062158 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3cca618d-d8b1-4195-944d-726d6c99f1fa tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:47.062772 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3cca618d-d8b1-4195-944d-726d6c99f1fa tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:47.066435 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:47.075194 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3cca618d-d8b1-4195-944d-726d6c99f1fa tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:47.075698 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3cca618d-d8b1-4195-944d-726d6c99f1fa tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:47.076169 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3cca618d-d8b1-4195-944d-726d6c99f1fa tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:47.076970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3cca618d-d8b1-4195-944d-726d6c99f1fa tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:47.077319 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3cca618d-d8b1-4195-944d-726d6c99f1fa tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:47.078292 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3cca618d-d8b1-4195-944d-726d6c99f1fa tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:47.299750 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3cca618d-d8b1-4195-944d-726d6c99f1fa tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:47.308172 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3cca618d-d8b1-4195-944d-726d6c99f1fa tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.250352 Aug 26 15:51:47.308758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 113/221] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:47 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:48.331363 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-8a82933c-c9e0-4536-a3c1-dc6c50547933 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:48.332268 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-8a82933c-c9e0-4536-a3c1-dc6c50547933 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:48.338763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8a82933c-c9e0-4536-a3c1-dc6c50547933 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:48.339317 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8a82933c-c9e0-4536-a3c1-dc6c50547933 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:48.339746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8a82933c-c9e0-4536-a3c1-dc6c50547933 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:48.340470 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8a82933c-c9e0-4536-a3c1-dc6c50547933 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:48.341238 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8a82933c-c9e0-4536-a3c1-dc6c50547933 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:48.341658 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8a82933c-c9e0-4536-a3c1-dc6c50547933 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:48.507364 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-8a82933c-c9e0-4536-a3c1-dc6c50547933 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:48.518188 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-8a82933c-c9e0-4536-a3c1-dc6c50547933 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.191187 Aug 26 15:51:48.524172 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 109/222] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:48 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:49.544596 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5f93cc17-a782-4af5-8c58-f77037161cae tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:49.546201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5f93cc17-a782-4af5-8c58-f77037161cae tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:49.554525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f93cc17-a782-4af5-8c58-f77037161cae tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:49.555123 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f93cc17-a782-4af5-8c58-f77037161cae tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:49.555666 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f93cc17-a782-4af5-8c58-f77037161cae tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:49.556527 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f93cc17-a782-4af5-8c58-f77037161cae tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:49.557085 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f93cc17-a782-4af5-8c58-f77037161cae tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:49.557678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f93cc17-a782-4af5-8c58-f77037161cae tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:49.807582 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-5f93cc17-a782-4af5-8c58-f77037161cae tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:49.819495 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5f93cc17-a782-4af5-8c58-f77037161cae tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.284545 Aug 26 15:51:49.820106 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 114/223] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:49 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:50.841577 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-05677435-4529-439b-8abb-09cb59dd8f22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:50.842184 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-05677435-4529-439b-8abb-09cb59dd8f22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:50.849399 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-05677435-4529-439b-8abb-09cb59dd8f22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:50.849877 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-05677435-4529-439b-8abb-09cb59dd8f22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:50.850309 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-05677435-4529-439b-8abb-09cb59dd8f22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:50.850999 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-05677435-4529-439b-8abb-09cb59dd8f22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:50.851449 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-05677435-4529-439b-8abb-09cb59dd8f22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:50.851892 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-05677435-4529-439b-8abb-09cb59dd8f22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:50.998936 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-05677435-4529-439b-8abb-09cb59dd8f22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:51.012078 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-05677435-4529-439b-8abb-09cb59dd8f22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.174354 Aug 26 15:51:51.013311 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 110/224] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:50 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:52.034216 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0e0ffa60-18a6-496b-a11a-179e9a73e614 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:52.037859 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0e0ffa60-18a6-496b-a11a-179e9a73e614 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:52.047789 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0e0ffa60-18a6-496b-a11a-179e9a73e614 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:52.048438 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0e0ffa60-18a6-496b-a11a-179e9a73e614 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:52.048954 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0e0ffa60-18a6-496b-a11a-179e9a73e614 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:52.049861 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0e0ffa60-18a6-496b-a11a-179e9a73e614 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:52.050478 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0e0ffa60-18a6-496b-a11a-179e9a73e614 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:52.050905 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0e0ffa60-18a6-496b-a11a-179e9a73e614 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:52.304087 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0e0ffa60-18a6-496b-a11a-179e9a73e614 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:52.312813 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0e0ffa60-18a6-496b-a11a-179e9a73e614 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.282009 Aug 26 15:51:52.313395 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 115/225] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:52 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:53.338401 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-63b834fb-21a5-4653-987a-323ed9bb01dd tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:53.339405 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-63b834fb-21a5-4653-987a-323ed9bb01dd tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:53.359680 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=44 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:53.359680 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-63b834fb-21a5-4653-987a-323ed9bb01dd tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:53.359680 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-63b834fb-21a5-4653-987a-323ed9bb01dd tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:53.359680 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-63b834fb-21a5-4653-987a-323ed9bb01dd tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:53.360102 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-63b834fb-21a5-4653-987a-323ed9bb01dd tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:53.360102 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-63b834fb-21a5-4653-987a-323ed9bb01dd tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:53.363630 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-63b834fb-21a5-4653-987a-323ed9bb01dd tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:53.665615 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-63b834fb-21a5-4653-987a-323ed9bb01dd tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:53.678019 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-63b834fb-21a5-4653-987a-323ed9bb01dd tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.345991 Aug 26 15:51:53.678988 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 111/226] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:53 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:54.709525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-df094040-844d-44ea-867a-97b5fd768d98 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:54.710131 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-df094040-844d-44ea-867a-97b5fd768d98 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:54.716078 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-df094040-844d-44ea-867a-97b5fd768d98 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:54.716555 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-df094040-844d-44ea-867a-97b5fd768d98 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:54.716987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-df094040-844d-44ea-867a-97b5fd768d98 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:54.717744 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-df094040-844d-44ea-867a-97b5fd768d98 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:54.718725 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-df094040-844d-44ea-867a-97b5fd768d98 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:54.720084 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-df094040-844d-44ea-867a-97b5fd768d98 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:54.890711 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-df094040-844d-44ea-867a-97b5fd768d98 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:54.898440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-df094040-844d-44ea-867a-97b5fd768d98 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1501 microversion: 2.1 time: 0.192765 Aug 26 15:51:54.899001 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 116/227] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:54 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1501 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:54.922795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d00ea816-3134-43c6-a0c0-dd37250dcce2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "439d656d-06d6-44c7-b935-62d42e69e799"}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:51:54.925728 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d00ea816-3134-43c6-a0c0-dd37250dcce2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:54.932326 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d00ea816-3134-43c6-a0c0-dd37250dcce2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:54.932903 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d00ea816-3134-43c6-a0c0-dd37250dcce2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:54.933404 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d00ea816-3134-43c6-a0c0-dd37250dcce2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:54.934197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d00ea816-3134-43c6-a0c0-dd37250dcce2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:54.934728 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d00ea816-3134-43c6-a0c0-dd37250dcce2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:54.935215 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d00ea816-3134-43c6-a0c0-dd37250dcce2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:54.963897 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-d00ea816-3134-43c6-a0c0-dd37250dcce2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] HTTP exception thrown: Cannot 'attach_volume' instance eae5c9c4-de22-4f03-a66b-3b0a632131e0 while it is in vm_state rescued Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d00ea816-3134-43c6-a0c0-dd37250dcce2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Request method failure captured: Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: POST /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0/os-volume_attachments HTTP/1.1 Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 74 Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOu4mB4haQKordFhuZBlwEB2sjzB1Ggq0RGqd_gZMlk7fOoxmsTjHxDr7EkB7u8NObi4d6APbLdClBiJmlJAqHVshko5l_rzaX5t4_54zFPQBeYab44MgJPCU1k-0j6OBkr3q7IvEClkDHMwJxZPzPX7sgNHTQ4qdi7FVVy-db3TXrw Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: 853df33daae14bd9825788afd555e11a Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1564618252 Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:51:54.966666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:51:54.968146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/853df33daae14bd9825788afd555e11a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_853df33daae14bd9825788afd555e11a", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/853df33daae14bd9825788afd555e11a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/853df33daae14bd9825788afd555e11a"}]}] Aug 26 15:51:54.968146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1564618252 Aug 26 15:51:54.968146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: 853df33daae14bd9825788afd555e11a Aug 26 15:51:54.968146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1564618252 Aug 26 15:51:54.968146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-ServerRescueNegativeTestJSON-1564618252-project Aug 26 15:51:54.968146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:51:54.968146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:51:54.968146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 5c01a893d3ab42cc97508768791ff38e Aug 26 15:51:54.968146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1564618252-project Aug 26 15:51:54.968146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Aug 26 15:51:54.968146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {"volumeAttachment": {"volumeId": "439d656d-06d6-44c7-b935-62d42e69e799"}} Aug 26 15:51:54.968146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Cannot 'attach_volume' instance eae5c9c4-de22-4f03-a66b-3b0a632131e0 while it is in vm_state rescued Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'server_id': 'eae5c9c4-de22-4f03-a66b-3b0a632131e0', 'body': {'volumeAttachment': {'volumeId': '439d656d-06d6-44c7-b935-62d42e69e799'}}} Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eae5c9c4-de22-4f03-a66b-3b0a632131e0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:51:54.969583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance eae5c9c4-de22-4f03-a66b-3b0a632131e0 while it is in vm_state rescued Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:51:54.971768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:51:54.976162 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:51:54.976162 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:51:54.976162 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance eae5c9c4-de22-4f03-a66b-3b0a632131e0 while it is in vm_state rescued Aug 26 15:51:54.976162 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:51:54.976162 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d00ea816-3134-43c6-a0c0-dd37250dcce2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Returning 409 to user: Cannot 'attach_volume' instance eae5c9c4-de22-4f03-a66b-3b0a632131e0 while it is in vm_state rescued {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:51:54.976162 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d00ea816-3134-43c6-a0c0-dd37250dcce2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "POST /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049846 Aug 26 15:51:54.976162 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 112/228] 10.222.0.98 () {60 vars in 1323 bytes} [Fri Aug 26 15:51:54 2022] POST /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 26 15:51:54.978819 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-9e1872b7-bce7-46f9-a61d-a3e7641ffff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:51:54.979347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-9e1872b7-bce7-46f9-a61d-a3e7641ffff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:54.986697 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9e1872b7-bce7-46f9-a61d-a3e7641ffff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:54.987189 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9e1872b7-bce7-46f9-a61d-a3e7641ffff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:54.988401 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9e1872b7-bce7-46f9-a61d-a3e7641ffff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:54.989462 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9e1872b7-bce7-46f9-a61d-a3e7641ffff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:54.989811 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9e1872b7-bce7-46f9-a61d-a3e7641ffff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:54.990238 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9e1872b7-bce7-46f9-a61d-a3e7641ffff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:55.251645 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-9e1872b7-bce7-46f9-a61d-a3e7641ffff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "POST /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0/action" status: 202 len: 0 microversion: 2.1 time: 0.276441 Aug 26 15:51:55.252593 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 117/229] 10.222.0.98 () {60 vars in 1278 bytes} [Fri Aug 26 15:51:54 2022] POST /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:51:55.264004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9104148b-1f16-4828-be0e-c70e452e56b5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:55.269078 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9104148b-1f16-4828-be0e-c70e452e56b5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:55.295663 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9104148b-1f16-4828-be0e-c70e452e56b5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:55.301708 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9104148b-1f16-4828-be0e-c70e452e56b5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:55.302172 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9104148b-1f16-4828-be0e-c70e452e56b5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:55.304838 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9104148b-1f16-4828-be0e-c70e452e56b5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:55.305496 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9104148b-1f16-4828-be0e-c70e452e56b5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:55.307329 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9104148b-1f16-4828-be0e-c70e452e56b5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:55.738444 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9104148b-1f16-4828-be0e-c70e452e56b5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:55.746693 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9104148b-1f16-4828-be0e-c70e452e56b5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1509 microversion: 2.1 time: 0.489057 Aug 26 15:51:55.747265 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 113/230] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:55 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1509 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:51:56.715944 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b6965089-c308-465b-ab2f-40159d527716 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Action: 'create', calling method: .version_select at 0x7fbd1e3f2ca0>, body: {"keypair": {"name": "tempest-keypair-1411814874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN/Q/19sGoLNnsEJX7MJH4SQt5/GMytJXUzO0SpSkXU35yyaygr+0zNMO7E8JNgTHt8SBd0Bu501a1BJJ4woxTzyNXlyjWPID4uFx/G69+2Y/TBBSSnwXmYuxvcJfO64A=="}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:51:56.715944 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-b6965089-c308-465b-ab2f-40159d527716 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for project f40d6476c750438c9c09107c7757fa95. Resources: {'key_pairs'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:51:56.715944 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-b6965089-c308-465b-ab2f-40159d527716 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for user 9348310fd06b473786d1c6be4f20c481 and project f40d6476c750438c9c09107c7757fa95. Resources: {'key_pairs'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:51:56.767610 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c7b035c5-226d-4af6-a564-0b1369d0af85 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:56.768249 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c7b035c5-226d-4af6-a564-0b1369d0af85 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:56.774838 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7b035c5-226d-4af6-a564-0b1369d0af85 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:56.775318 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7b035c5-226d-4af6-a564-0b1369d0af85 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:56.775745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7b035c5-226d-4af6-a564-0b1369d0af85 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:56.776463 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7b035c5-226d-4af6-a564-0b1369d0af85 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:56.776911 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7b035c5-226d-4af6-a564-0b1369d0af85 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:56.777330 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7b035c5-226d-4af6-a564-0b1369d0af85 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:56.903898 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c7b035c5-226d-4af6-a564-0b1369d0af85 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:56.911508 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c7b035c5-226d-4af6-a564-0b1369d0af85 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1509 microversion: 2.1 time: 0.147866 Aug 26 15:51:56.912439 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 114/231] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:56 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:51:56.996878 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-b6965089-c308-465b-ab2f-40159d527716 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.442948 Aug 26 15:51:56.997517 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 118/232] 10.222.0.98 () {60 vars in 1159 bytes} [Fri Aug 26 15:51:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:51:57.117912 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0ec77e2d-c343-41ef-993f-8b66762c0853 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:57.118417 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0ec77e2d-c343-41ef-993f-8b66762c0853 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:57.125050 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ec77e2d-c343-41ef-993f-8b66762c0853 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:57.125534 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ec77e2d-c343-41ef-993f-8b66762c0853 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:57.125972 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ec77e2d-c343-41ef-993f-8b66762c0853 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:57.126676 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ec77e2d-c343-41ef-993f-8b66762c0853 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:57.127137 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ec77e2d-c343-41ef-993f-8b66762c0853 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:57.127580 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ec77e2d-c343-41ef-993f-8b66762c0853 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:57.167484 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=100 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:57.177168 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0ec77e2d-c343-41ef-993f-8b66762c0853 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/ips" status: 200 len: 145 microversion: 2.1 time: 0.063131 Aug 26 15:51:57.184590 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 115/233] 10.222.0.98 () {58 vars in 1248 bytes} [Fri Aug 26 15:51:57 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/ips => generated 145 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:51:57.933853 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-82fab928-e171-4b84-a077-5542de82f8e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:57.935324 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-82fab928-e171-4b84-a077-5542de82f8e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:57.944645 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-82fab928-e171-4b84-a077-5542de82f8e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:57.945127 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-82fab928-e171-4b84-a077-5542de82f8e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:57.948018 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-82fab928-e171-4b84-a077-5542de82f8e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:57.948981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-82fab928-e171-4b84-a077-5542de82f8e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:57.949625 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-82fab928-e171-4b84-a077-5542de82f8e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:57.950284 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-82fab928-e171-4b84-a077-5542de82f8e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:58.091155 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-82fab928-e171-4b84-a077-5542de82f8e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:58.099225 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-82fab928-e171-4b84-a077-5542de82f8e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1509 microversion: 2.1 time: 0.169694 Aug 26 15:51:58.099793 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 119/234] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:57 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:51:59.137536 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9331dae1-6e60-426c-8643-a3bb003e326b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:59.138700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9331dae1-6e60-426c-8643-a3bb003e326b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:51:59.148491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9331dae1-6e60-426c-8643-a3bb003e326b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:59.149245 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9331dae1-6e60-426c-8643-a3bb003e326b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:59.149688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9331dae1-6e60-426c-8643-a3bb003e326b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:59.150398 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9331dae1-6e60-426c-8643-a3bb003e326b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:51:59.151021 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9331dae1-6e60-426c-8643-a3bb003e326b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:51:59.151449 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9331dae1-6e60-426c-8643-a3bb003e326b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:51:59.373171 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9331dae1-6e60-426c-8643-a3bb003e326b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:51:59.391671 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9331dae1-6e60-426c-8643-a3bb003e326b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1515 microversion: 2.1 time: 0.257857 Aug 26 15:51:59.392294 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 116/235] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:51:59 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:00.650321 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-147414707", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a335b766-ffd8-4d30-a4fc-6d81d957bfbd"}], "security_groups": [{"name": "tempest-securitygroup--156522175"}], "key_name": "tempest-keypair-1411814874", "user_data": "}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:00.767590 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.network.neutron [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] validate_networks() for [('a335b766-ffd8-4d30-a4fc-6d81d957bfbd', None, None, None, None, None)] {{(pid=127698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:52:01.167761 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Flavor limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:52:01.167761 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Image limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:52:01.167761 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Flavor pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:52:01.167761 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Image pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:52:01.167761 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:52:01.175707 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:01.176577 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:01.176769 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:01.177551 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:01.178192 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:01.178621 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:01.201112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for project f40d6476c750438c9c09107c7757fa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:52:01.206136 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for user 9348310fd06b473786d1c6be4f20c481 and project f40d6476c750438c9c09107c7757fa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:52:01.217734 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Going to run 1 instances... {{(pid=127698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:52:01.220692 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:52:01.440053 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-07eaf006-cc99-450d-ae81-42c03080c281 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.793985 Aug 26 15:52:01.441434 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 120/236] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:52:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:52:01.466866 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e8b4f790-4b5d-4d4d-abec-23a81775515e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:01.467605 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e8b4f790-4b5d-4d4d-abec-23a81775515e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:01.589519 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e8b4f790-4b5d-4d4d-abec-23a81775515e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:01.601997 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e8b4f790-4b5d-4d4d-abec-23a81775515e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1241 microversion: 2.1 time: 0.150985 Aug 26 15:52:01.605174 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 117/237] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:01 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1241 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:01.663950 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-10a8ab34-9161-436e-aa31-931753c4a9cb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Action: 'create', calling method: .version_select at 0x7fbd1e3ba310>, body: {"keypair": {"name": "tempest-keypair-175078371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEvXTefYwSvpelA5FG8t1Me17fGCUvT9m8Lg2kQ7Mxdc5bmV+k0y7EsUTmyzy6Fnf3U5650yp0kw61z4AjYDe3nEh3HQz03WjlB9Qk8fOg4ETHHYsmPMH9BUKXJBSgdvw=="}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:01.696207 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-10a8ab34-9161-436e-aa31-931753c4a9cb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Getting quotas for project 853df33daae14bd9825788afd555e11a. Resources: {'key_pairs'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:52:01.701785 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-10a8ab34-9161-436e-aa31-931753c4a9cb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Getting quotas for user 5c01a893d3ab42cc97508768791ff38e and project 853df33daae14bd9825788afd555e11a. Resources: {'key_pairs'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:52:01.852027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-10a8ab34-9161-436e-aa31-931753c4a9cb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.191840 Aug 26 15:52:01.856725 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 121/238] 10.222.0.98 () {60 vars in 1159 bytes} [Fri Aug 26 15:52:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:52:02.158595 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5cb0c013-3f07-422d-b469-001d26fe6614 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfa52430-c05f-41fb-81e9-8cccf1cf7058"}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:02.161053 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5cb0c013-3f07-422d-b469-001d26fe6614 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:02.182279 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5cb0c013-3f07-422d-b469-001d26fe6614 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:02.185626 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5cb0c013-3f07-422d-b469-001d26fe6614 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:02.185626 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5cb0c013-3f07-422d-b469-001d26fe6614 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:02.185626 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5cb0c013-3f07-422d-b469-001d26fe6614 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:02.185626 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5cb0c013-3f07-422d-b469-001d26fe6614 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:02.186515 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5cb0c013-3f07-422d-b469-001d26fe6614 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:02.624296 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a4973e08-95d6-4ecc-be75-35b2c3ad9499 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:02.625522 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a4973e08-95d6-4ecc-be75-35b2c3ad9499 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:02.704162 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-a4973e08-95d6-4ecc-be75-35b2c3ad9499 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:02.712473 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-a4973e08-95d6-4ecc-be75-35b2c3ad9499 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1241 microversion: 2.1 time: 0.092134 Aug 26 15:52:02.724400 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 122/239] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:02 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:52:03.602071 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5cb0c013-3f07-422d-b469-001d26fe6614 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "POST /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.447695 Aug 26 15:52:03.607910 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 118/240] 10.222.0.98 () {60 vars in 1323 bytes} [Fri Aug 26 15:52:02 2022] POST /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/os-volume_attachments => generated 194 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:52:03.734371 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3c3d0554-bf5e-46a9-b99a-599248c40e9f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:03.735519 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3c3d0554-bf5e-46a9-b99a-599248c40e9f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:03.742684 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3c3d0554-bf5e-46a9-b99a-599248c40e9f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:03.743508 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3c3d0554-bf5e-46a9-b99a-599248c40e9f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:03.744279 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3c3d0554-bf5e-46a9-b99a-599248c40e9f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:03.745484 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3c3d0554-bf5e-46a9-b99a-599248c40e9f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:03.746010 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3c3d0554-bf5e-46a9-b99a-599248c40e9f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:03.746622 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3c3d0554-bf5e-46a9-b99a-599248c40e9f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:03.830000 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3c3d0554-bf5e-46a9-b99a-599248c40e9f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:03.837532 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3c3d0554-bf5e-46a9-b99a-599248c40e9f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1245 microversion: 2.1 time: 0.107954 Aug 26 15:52:03.838198 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 123/241] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:03 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:04.860085 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-aecc3309-e5b8-4acd-b118-257ac71d237a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:04.860861 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-aecc3309-e5b8-4acd-b118-257ac71d237a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:04.868710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aecc3309-e5b8-4acd-b118-257ac71d237a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:04.869358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aecc3309-e5b8-4acd-b118-257ac71d237a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:04.870677 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aecc3309-e5b8-4acd-b118-257ac71d237a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:04.870677 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aecc3309-e5b8-4acd-b118-257ac71d237a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:04.870931 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aecc3309-e5b8-4acd-b118-257ac71d237a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:04.871442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aecc3309-e5b8-4acd-b118-257ac71d237a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:04.956389 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-aecc3309-e5b8-4acd-b118-257ac71d237a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:04.964176 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-aecc3309-e5b8-4acd-b118-257ac71d237a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1293 microversion: 2.1 time: 0.109204 Aug 26 15:52:04.964784 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 119/242] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:04 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:05.629248 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2122548611", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cab596ab-7d04-4922-b3cc-a5bd19fc2e98"}], "security_groups": [{"name": "tempest-securitygroup--1039623543"}], "key_name": "tempest-keypair-175078371", "user_data": "}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:05.746109 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.network.neutron [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] validate_networks() for [('cab596ab-7d04-4922-b3cc-a5bd19fc2e98', None, None, None, None, None)] {{(pid=127698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:52:05.992154 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-66276523-e8a2-4a0b-b7ac-2633c75ac2a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:05.992811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-66276523-e8a2-4a0b-b7ac-2633c75ac2a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:06.002809 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-66276523-e8a2-4a0b-b7ac-2633c75ac2a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:06.003170 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-66276523-e8a2-4a0b-b7ac-2633c75ac2a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:06.003754 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-66276523-e8a2-4a0b-b7ac-2633c75ac2a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:06.004528 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-66276523-e8a2-4a0b-b7ac-2633c75ac2a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:06.004956 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-66276523-e8a2-4a0b-b7ac-2633c75ac2a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:06.005379 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-66276523-e8a2-4a0b-b7ac-2633c75ac2a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:06.099794 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-66276523-e8a2-4a0b-b7ac-2633c75ac2a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:06.109675 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-66276523-e8a2-4a0b-b7ac-2633c75ac2a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1299 microversion: 2.1 time: 0.123332 Aug 26 15:52:06.110794 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 120/243] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:05 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:52:06.913253 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Flavor limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:52:06.913903 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Image limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:52:06.914305 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Flavor pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:52:06.914786 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Image pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:52:06.915266 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:52:06.927357 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:06.928282 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:06.928939 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:06.929982 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:06.933726 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:06.933726 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:06.969402 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Getting quotas for project 853df33daae14bd9825788afd555e11a. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:52:06.973875 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Getting quotas for user 5c01a893d3ab42cc97508768791ff38e and project 853df33daae14bd9825788afd555e11a. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:52:06.988615 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Going to run 1 instances... {{(pid=127698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:52:06.991436 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:52:07.116167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-58c9ce97-e4bd-49b3-915b-be1ba9e20125 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.491848 Aug 26 15:52:07.123105 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 124/244] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:52:05 2022] POST /compute/v2.1/servers => generated 409 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 15:52:07.133240 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-76d7a32b-3fb6-4f47-a0c6-96bb4f01cf53 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:07.134190 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-76d7a32b-3fb6-4f47-a0c6-96bb4f01cf53 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:07.138743 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-99afe3bf-4827-4324-b7ab-6a6a1d48dc07 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:07.142312 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-99afe3bf-4827-4324-b7ab-6a6a1d48dc07 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:07.156985 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76d7a32b-3fb6-4f47-a0c6-96bb4f01cf53 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:07.157546 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76d7a32b-3fb6-4f47-a0c6-96bb4f01cf53 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:07.158058 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76d7a32b-3fb6-4f47-a0c6-96bb4f01cf53 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:07.158695 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76d7a32b-3fb6-4f47-a0c6-96bb4f01cf53 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:07.159149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76d7a32b-3fb6-4f47-a0c6-96bb4f01cf53 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:07.159573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76d7a32b-3fb6-4f47-a0c6-96bb4f01cf53 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:07.335200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-99afe3bf-4827-4324-b7ab-6a6a1d48dc07 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:07.349142 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-99afe3bf-4827-4324-b7ab-6a6a1d48dc07 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1245 microversion: 2.1 time: 0.224446 Aug 26 15:52:07.351808 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 121/245] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:07 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1245 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:52:07.469030 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-76d7a32b-3fb6-4f47-a0c6-96bb4f01cf53 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:07.477438 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-76d7a32b-3fb6-4f47-a0c6-96bb4f01cf53 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1366 microversion: 2.1 time: 0.348711 Aug 26 15:52:07.478021 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 125/246] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:07 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:08.053975 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-3005a412-8071-4d2d-b1ba-302ccfc62fbd req-bff5cd33-6467-4bab-9e67-a90990dcca4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "241a08df-4027-4153-8284-9ef744c15cb5", "tag": "9978d447-2f15-4512-9675-bfc09607f200"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:08.065231 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-3005a412-8071-4d2d-b1ba-302ccfc62fbd req-bff5cd33-6467-4bab-9e67-a90990dcca4c service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:08.066061 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-3005a412-8071-4d2d-b1ba-302ccfc62fbd req-bff5cd33-6467-4bab-9e67-a90990dcca4c service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:08.066599 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-3005a412-8071-4d2d-b1ba-302ccfc62fbd req-bff5cd33-6467-4bab-9e67-a90990dcca4c service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:08.081222 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-3005a412-8071-4d2d-b1ba-302ccfc62fbd req-bff5cd33-6467-4bab-9e67-a90990dcca4c service nova] Creating event network-changed:9978d447-2f15-4512-9675-bfc09607f200 for instance 241a08df-4027-4153-8284-9ef744c15cb5 on hv-cinder-83124 Aug 26 15:52:08.096779 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-3005a412-8071-4d2d-b1ba-302ccfc62fbd req-bff5cd33-6467-4bab-9e67-a90990dcca4c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049423 Aug 26 15:52:08.096779 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 122/247] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:52:08.379655 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c3af9bb5-133c-4a5f-820d-824e8c722820 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:08.381014 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c3af9bb5-133c-4a5f-820d-824e8c722820 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:08.491799 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c3af9bb5-133c-4a5f-820d-824e8c722820 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:08.500339 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c3af9bb5-133c-4a5f-820d-824e8c722820 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1245 microversion: 2.1 time: 0.127834 Aug 26 15:52:08.501482 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-dd0edee2-329a-4c4c-a35f-5563c51143c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:08.502045 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 126/248] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:08 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1245 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:08.503004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-dd0edee2-329a-4c4c-a35f-5563c51143c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:08.509652 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dd0edee2-329a-4c4c-a35f-5563c51143c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:08.512060 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dd0edee2-329a-4c4c-a35f-5563c51143c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:08.512060 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dd0edee2-329a-4c4c-a35f-5563c51143c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:08.512060 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dd0edee2-329a-4c4c-a35f-5563c51143c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:08.512060 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dd0edee2-329a-4c4c-a35f-5563c51143c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:08.512413 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dd0edee2-329a-4c4c-a35f-5563c51143c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:08.817161 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-dd0edee2-329a-4c4c-a35f-5563c51143c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:08.826855 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-dd0edee2-329a-4c4c-a35f-5563c51143c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1366 microversion: 2.1 time: 0.331899 Aug 26 15:52:08.827927 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 123/249] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:08 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:52:09.522958 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-66ccbc9d-be7d-487e-a607-f50af2ebc71f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:09.524369 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-66ccbc9d-be7d-487e-a607-f50af2ebc71f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:09.534180 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66ccbc9d-be7d-487e-a607-f50af2ebc71f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:09.535065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66ccbc9d-be7d-487e-a607-f50af2ebc71f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:09.543410 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66ccbc9d-be7d-487e-a607-f50af2ebc71f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:09.543410 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66ccbc9d-be7d-487e-a607-f50af2ebc71f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:09.543410 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66ccbc9d-be7d-487e-a607-f50af2ebc71f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:09.543410 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66ccbc9d-be7d-487e-a607-f50af2ebc71f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:09.633731 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-66ccbc9d-be7d-487e-a607-f50af2ebc71f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:09.644721 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-66ccbc9d-be7d-487e-a607-f50af2ebc71f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1297 microversion: 2.1 time: 0.126403 Aug 26 15:52:09.663905 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 127/250] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:09 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1297 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:09.848030 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9b0dca31-3efa-413c-a541-ad3ea6158ced tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:09.848638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9b0dca31-3efa-413c-a541-ad3ea6158ced tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:09.855151 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b0dca31-3efa-413c-a541-ad3ea6158ced tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:09.855625 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b0dca31-3efa-413c-a541-ad3ea6158ced tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:09.856119 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b0dca31-3efa-413c-a541-ad3ea6158ced tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:09.856791 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b0dca31-3efa-413c-a541-ad3ea6158ced tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:09.857236 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b0dca31-3efa-413c-a541-ad3ea6158ced tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:09.857652 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b0dca31-3efa-413c-a541-ad3ea6158ced tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:10.025219 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9b0dca31-3efa-413c-a541-ad3ea6158ced tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:10.041349 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9b0dca31-3efa-413c-a541-ad3ea6158ced tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1366 microversion: 2.1 time: 0.196957 Aug 26 15:52:10.042384 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 124/251] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:09 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:10.667376 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8f4793fb-0664-4641-8a38-2f224d38080a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:10.669078 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-8f4793fb-0664-4641-8a38-2f224d38080a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:10.676284 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f4793fb-0664-4641-8a38-2f224d38080a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:10.676773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f4793fb-0664-4641-8a38-2f224d38080a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:10.677507 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f4793fb-0664-4641-8a38-2f224d38080a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:10.678239 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f4793fb-0664-4641-8a38-2f224d38080a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:10.678609 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f4793fb-0664-4641-8a38-2f224d38080a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:10.679067 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f4793fb-0664-4641-8a38-2f224d38080a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:10.752989 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8f4793fb-0664-4641-8a38-2f224d38080a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:10.761335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-8f4793fb-0664-4641-8a38-2f224d38080a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1297 microversion: 2.1 time: 0.098354 Aug 26 15:52:10.766290 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 128/252] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:10 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1297 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:11.076161 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b2dab129-20ec-4943-847f-446a545538c1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:11.077589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b2dab129-20ec-4943-847f-446a545538c1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:11.089982 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b2dab129-20ec-4943-847f-446a545538c1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:11.090816 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b2dab129-20ec-4943-847f-446a545538c1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:11.092604 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b2dab129-20ec-4943-847f-446a545538c1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:11.094504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b2dab129-20ec-4943-847f-446a545538c1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:11.095172 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b2dab129-20ec-4943-847f-446a545538c1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:11.096301 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b2dab129-20ec-4943-847f-446a545538c1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:11.310796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b2dab129-20ec-4943-847f-446a545538c1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:11.320925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b2dab129-20ec-4943-847f-446a545538c1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1366 microversion: 2.1 time: 0.250373 Aug 26 15:52:11.321511 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 125/253] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:11 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:11.788082 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4d32009c-c4f0-445d-9e55-4de119fd1866 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:11.799434 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-4d32009c-c4f0-445d-9e55-4de119fd1866 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:11.799434 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4d32009c-c4f0-445d-9e55-4de119fd1866 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:11.799434 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4d32009c-c4f0-445d-9e55-4de119fd1866 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:11.799434 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4d32009c-c4f0-445d-9e55-4de119fd1866 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:11.799967 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4d32009c-c4f0-445d-9e55-4de119fd1866 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:11.799967 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4d32009c-c4f0-445d-9e55-4de119fd1866 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:11.799967 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4d32009c-c4f0-445d-9e55-4de119fd1866 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:11.865887 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4d32009c-c4f0-445d-9e55-4de119fd1866 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:11.877829 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4d32009c-c4f0-445d-9e55-4de119fd1866 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1305 microversion: 2.1 time: 0.093667 Aug 26 15:52:11.878613 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 129/254] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:11 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:12.345476 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c486fe81-91a1-4013-9783-458dd278c9fa tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:12.346686 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c486fe81-91a1-4013-9783-458dd278c9fa tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:12.370554 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c486fe81-91a1-4013-9783-458dd278c9fa tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:12.375566 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c486fe81-91a1-4013-9783-458dd278c9fa tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:12.375566 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c486fe81-91a1-4013-9783-458dd278c9fa tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:12.375566 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c486fe81-91a1-4013-9783-458dd278c9fa tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:12.375566 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c486fe81-91a1-4013-9783-458dd278c9fa tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:12.376162 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c486fe81-91a1-4013-9783-458dd278c9fa tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:12.826719 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c486fe81-91a1-4013-9783-458dd278c9fa tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:12.837053 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c486fe81-91a1-4013-9783-458dd278c9fa tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1366 microversion: 2.1 time: 0.495914 Aug 26 15:52:12.839578 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 126/255] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:12 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1366 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:12.901570 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-136c8c8f-a80f-4621-b7ea-43d551f67b8b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:12.902961 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-136c8c8f-a80f-4621-b7ea-43d551f67b8b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:12.909947 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-136c8c8f-a80f-4621-b7ea-43d551f67b8b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:12.910442 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-136c8c8f-a80f-4621-b7ea-43d551f67b8b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:12.910885 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-136c8c8f-a80f-4621-b7ea-43d551f67b8b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:12.911590 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-136c8c8f-a80f-4621-b7ea-43d551f67b8b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:12.912096 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-136c8c8f-a80f-4621-b7ea-43d551f67b8b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:12.912692 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-136c8c8f-a80f-4621-b7ea-43d551f67b8b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:13.017813 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-136c8c8f-a80f-4621-b7ea-43d551f67b8b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:13.032548 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-136c8c8f-a80f-4621-b7ea-43d551f67b8b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1303 microversion: 2.1 time: 0.136382 Aug 26 15:52:13.035482 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 130/256] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:12 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1303 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:13.838376 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-88917bc9-e733-408c-befe-63b8f9ffc7ac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:13.851128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-88917bc9-e733-408c-befe-63b8f9ffc7ac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:13.856026 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-88917bc9-e733-408c-befe-63b8f9ffc7ac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:13.856026 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-88917bc9-e733-408c-befe-63b8f9ffc7ac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:13.867342 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-65d70b78-c999-4aaf-a2fa-0417cde700d8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:13.870879 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-65d70b78-c999-4aaf-a2fa-0417cde700d8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:13.887267 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65d70b78-c999-4aaf-a2fa-0417cde700d8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:13.891419 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65d70b78-c999-4aaf-a2fa-0417cde700d8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:13.892507 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65d70b78-c999-4aaf-a2fa-0417cde700d8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:13.894668 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65d70b78-c999-4aaf-a2fa-0417cde700d8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:13.897101 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65d70b78-c999-4aaf-a2fa-0417cde700d8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:13.897101 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65d70b78-c999-4aaf-a2fa-0417cde700d8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:14.059107 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-88917bc9-e733-408c-befe-63b8f9ffc7ac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Going to try to stop instance {{(pid=127697) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 15:52:14.331466 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-88917bc9-e733-408c-befe-63b8f9ffc7ac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "POST /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/action" status: 202 len: 0 microversion: 2.1 time: 0.496953 Aug 26 15:52:14.332332 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 127/257] 10.222.0.98 () {60 vars in 1278 bytes} [Fri Aug 26 15:52:13 2022] POST /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:52:14.338682 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-65d70b78-c999-4aaf-a2fa-0417cde700d8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:14.345284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-4d357f7f-9f61-4f63-b642-013ad05b753c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:14.345284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-4d357f7f-9f61-4f63-b642-013ad05b753c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:14.353301 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-65d70b78-c999-4aaf-a2fa-0417cde700d8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1366 microversion: 2.1 time: 0.493828 Aug 26 15:52:14.356344 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 131/258] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:13 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1366 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:52:14.368146 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3025bb24-b64d-47be-8e34-c0c9d009aff3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:14.369050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3025bb24-b64d-47be-8e34-c0c9d009aff3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:14.388629 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3025bb24-b64d-47be-8e34-c0c9d009aff3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:14.389374 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3025bb24-b64d-47be-8e34-c0c9d009aff3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:14.389997 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3025bb24-b64d-47be-8e34-c0c9d009aff3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:14.390905 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3025bb24-b64d-47be-8e34-c0c9d009aff3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:14.391576 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3025bb24-b64d-47be-8e34-c0c9d009aff3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:14.391754 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3025bb24-b64d-47be-8e34-c0c9d009aff3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:14.392247 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4d357f7f-9f61-4f63-b642-013ad05b753c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:14.392756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4d357f7f-9f61-4f63-b642-013ad05b753c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:14.397263 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4d357f7f-9f61-4f63-b642-013ad05b753c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:14.399005 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4d357f7f-9f61-4f63-b642-013ad05b753c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:14.399005 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4d357f7f-9f61-4f63-b642-013ad05b753c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:14.407408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4d357f7f-9f61-4f63-b642-013ad05b753c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:14.997180 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-4d357f7f-9f61-4f63-b642-013ad05b753c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:15.019707 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-4d357f7f-9f61-4f63-b642-013ad05b753c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.680629 Aug 26 15:52:15.022257 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 128/259] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:14 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:15.052353 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-1d12ab3d-4820-433f-bf41-2698efc1f2d8 req-14460d86-47aa-408d-b9e8-0fc365fc0c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241a08df-4027-4153-8284-9ef744c15cb5", "name": "network-vif-plugged", "status": "completed", "tag": "9978d447-2f15-4512-9675-bfc09607f200"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:15.069215 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-1d12ab3d-4820-433f-bf41-2698efc1f2d8 req-14460d86-47aa-408d-b9e8-0fc365fc0c9e service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:15.071523 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-1d12ab3d-4820-433f-bf41-2698efc1f2d8 req-14460d86-47aa-408d-b9e8-0fc365fc0c9e service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:15.084854 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-1d12ab3d-4820-433f-bf41-2698efc1f2d8 req-14460d86-47aa-408d-b9e8-0fc365fc0c9e service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:15.118338 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-1d12ab3d-4820-433f-bf41-2698efc1f2d8 req-14460d86-47aa-408d-b9e8-0fc365fc0c9e service nova] Creating event network-vif-plugged:9978d447-2f15-4512-9675-bfc09607f200 for instance 241a08df-4027-4153-8284-9ef744c15cb5 on hv-cinder-83124 Aug 26 15:52:15.120436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-1d12ab3d-4820-433f-bf41-2698efc1f2d8 req-14460d86-47aa-408d-b9e8-0fc365fc0c9e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075274 Aug 26 15:52:15.124568 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 129/260] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:52:15.207390 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3025bb24-b64d-47be-8e34-c0c9d009aff3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:15.223705 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3025bb24-b64d-47be-8e34-c0c9d009aff3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.865886 Aug 26 15:52:15.228621 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 132/261] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:14 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:15.383734 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7f08230e-072d-4475-af71-275110453b99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:15.387922 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7f08230e-072d-4475-af71-275110453b99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:15.400326 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7f08230e-072d-4475-af71-275110453b99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:15.402252 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7f08230e-072d-4475-af71-275110453b99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:15.403440 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7f08230e-072d-4475-af71-275110453b99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:15.405869 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7f08230e-072d-4475-af71-275110453b99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:15.406582 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7f08230e-072d-4475-af71-275110453b99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:15.407272 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7f08230e-072d-4475-af71-275110453b99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:15.732454 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7f08230e-072d-4475-af71-275110453b99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:15.745306 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7f08230e-072d-4475-af71-275110453b99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1366 microversion: 2.1 time: 0.370568 Aug 26 15:52:15.748777 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 130/262] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:15 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:16.049360 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-94ee65f1-9f5f-4e4e-829f-f4d9538558a7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:16.050225 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-94ee65f1-9f5f-4e4e-829f-f4d9538558a7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:16.069546 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94ee65f1-9f5f-4e4e-829f-f4d9538558a7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:16.070967 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94ee65f1-9f5f-4e4e-829f-f4d9538558a7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:16.073797 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94ee65f1-9f5f-4e4e-829f-f4d9538558a7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:16.074598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94ee65f1-9f5f-4e4e-829f-f4d9538558a7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:16.075065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94ee65f1-9f5f-4e4e-829f-f4d9538558a7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:16.076881 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94ee65f1-9f5f-4e4e-829f-f4d9538558a7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:16.086601 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:52:16.228811 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-94ee65f1-9f5f-4e4e-829f-f4d9538558a7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:16.236876 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-94ee65f1-9f5f-4e4e-829f-f4d9538558a7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.194906 Aug 26 15:52:16.250918 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 133/263] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:16 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:16.256236 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-464ea8c8-8d80-4e40-a6fc-fede471f8418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:16.256803 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-ea0c85c1-557b-44ad-8243-ece4ccaa6333 req-760c4413-f42d-400d-9d8b-695c779c8cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d976c8-85c3-48de-80ba-93fdff79445a", "tag": "c5172524-b071-4da7-93f1-8465faf155b2"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:16.259039 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-464ea8c8-8d80-4e40-a6fc-fede471f8418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:16.266507 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-ea0c85c1-557b-44ad-8243-ece4ccaa6333 req-760c4413-f42d-400d-9d8b-695c779c8cea service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:16.267068 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-ea0c85c1-557b-44ad-8243-ece4ccaa6333 req-760c4413-f42d-400d-9d8b-695c779c8cea service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:16.267754 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-ea0c85c1-557b-44ad-8243-ece4ccaa6333 req-760c4413-f42d-400d-9d8b-695c779c8cea service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:16.270177 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-464ea8c8-8d80-4e40-a6fc-fede471f8418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:16.270770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-464ea8c8-8d80-4e40-a6fc-fede471f8418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:16.272100 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-464ea8c8-8d80-4e40-a6fc-fede471f8418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:16.273460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-464ea8c8-8d80-4e40-a6fc-fede471f8418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:16.274139 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-464ea8c8-8d80-4e40-a6fc-fede471f8418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:16.274797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-464ea8c8-8d80-4e40-a6fc-fede471f8418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:16.283267 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-ea0c85c1-557b-44ad-8243-ece4ccaa6333 req-760c4413-f42d-400d-9d8b-695c779c8cea service nova] Creating event network-changed:c5172524-b071-4da7-93f1-8465faf155b2 for instance 08d976c8-85c3-48de-80ba-93fdff79445a on hv-cinder-83124 Aug 26 15:52:16.290878 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-ea0c85c1-557b-44ad-8243-ece4ccaa6333 req-760c4413-f42d-400d-9d8b-695c779c8cea service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038351 Aug 26 15:52:16.291498 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 134/264] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:52:16.577416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-464ea8c8-8d80-4e40-a6fc-fede471f8418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:16.588968 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-464ea8c8-8d80-4e40-a6fc-fede471f8418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.343021 Aug 26 15:52:16.595693 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 131/265] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:16 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:16.769343 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5c5876d6-060c-40b2-a080-790664b88aec tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:16.770010 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5c5876d6-060c-40b2-a080-790664b88aec tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:16.772285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:52:16.777163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c5876d6-060c-40b2-a080-790664b88aec tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:16.777880 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c5876d6-060c-40b2-a080-790664b88aec tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:16.778582 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c5876d6-060c-40b2-a080-790664b88aec tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:16.779273 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c5876d6-060c-40b2-a080-790664b88aec tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:16.779936 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c5876d6-060c-40b2-a080-790664b88aec tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:16.780547 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c5876d6-060c-40b2-a080-790664b88aec tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:16.958749 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=4 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:52:17.106686 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-5c5876d6-060c-40b2-a080-790664b88aec tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:17.115451 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5c5876d6-060c-40b2-a080-790664b88aec tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1366 microversion: 2.1 time: 0.351284 Aug 26 15:52:17.116170 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 135/266] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:16 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:17.258606 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-158da0c0-49ae-4fd8-81d9-c49c465197c5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:17.259225 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-158da0c0-49ae-4fd8-81d9-c49c465197c5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:17.265813 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-158da0c0-49ae-4fd8-81d9-c49c465197c5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:17.266299 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-158da0c0-49ae-4fd8-81d9-c49c465197c5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:17.266735 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-158da0c0-49ae-4fd8-81d9-c49c465197c5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:17.267440 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-158da0c0-49ae-4fd8-81d9-c49c465197c5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:17.267908 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-158da0c0-49ae-4fd8-81d9-c49c465197c5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:17.268340 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-158da0c0-49ae-4fd8-81d9-c49c465197c5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:17.347704 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=4 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:52:17.416062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-158da0c0-49ae-4fd8-81d9-c49c465197c5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:17.426207 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-158da0c0-49ae-4fd8-81d9-c49c465197c5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.171368 Aug 26 15:52:17.426908 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 132/267] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:17 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:17.610839 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-26afb0c2-b680-45bc-b464-ab9cf078ef04 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:17.611445 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-26afb0c2-b680-45bc-b464-ab9cf078ef04 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:17.618015 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-26afb0c2-b680-45bc-b464-ab9cf078ef04 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:17.618491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-26afb0c2-b680-45bc-b464-ab9cf078ef04 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:17.618921 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-26afb0c2-b680-45bc-b464-ab9cf078ef04 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:17.619597 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-26afb0c2-b680-45bc-b464-ab9cf078ef04 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:17.620098 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-26afb0c2-b680-45bc-b464-ab9cf078ef04 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:17.620529 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-26afb0c2-b680-45bc-b464-ab9cf078ef04 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:18.144649 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a40eeb0c-8fdf-4ac1-a5d2-34d43799de67 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:18.146738 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a40eeb0c-8fdf-4ac1-a5d2-34d43799de67 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:18.183670 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a40eeb0c-8fdf-4ac1-a5d2-34d43799de67 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:18.184212 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a40eeb0c-8fdf-4ac1-a5d2-34d43799de67 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:18.185178 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a40eeb0c-8fdf-4ac1-a5d2-34d43799de67 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:18.186391 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a40eeb0c-8fdf-4ac1-a5d2-34d43799de67 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:18.186906 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a40eeb0c-8fdf-4ac1-a5d2-34d43799de67 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:18.187392 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a40eeb0c-8fdf-4ac1-a5d2-34d43799de67 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:18.217393 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:52:18.255399 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-26afb0c2-b680-45bc-b464-ab9cf078ef04 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:18.276985 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-26afb0c2-b680-45bc-b464-ab9cf078ef04 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.670125 Aug 26 15:52:18.280174 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 136/268] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:17 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:18.401661 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a40eeb0c-8fdf-4ac1-a5d2-34d43799de67 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:18.411566 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a40eeb0c-8fdf-4ac1-a5d2-34d43799de67 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1555 microversion: 2.1 time: 0.277774 Aug 26 15:52:18.412488 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 133/269] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:18 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1555 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:52:18.443446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-13442e66-82b9-4333-9e55-e04a37d69902 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:18.443980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-13442e66-82b9-4333-9e55-e04a37d69902 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:18.448877 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-863810ff-8d83-42ff-b02e-e129678aaa22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:18.449631 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-863810ff-8d83-42ff-b02e-e129678aaa22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:18.450226 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-13442e66-82b9-4333-9e55-e04a37d69902 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:18.450720 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-13442e66-82b9-4333-9e55-e04a37d69902 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:18.451147 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-13442e66-82b9-4333-9e55-e04a37d69902 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:18.451851 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-13442e66-82b9-4333-9e55-e04a37d69902 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:18.452328 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-13442e66-82b9-4333-9e55-e04a37d69902 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:18.452747 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-13442e66-82b9-4333-9e55-e04a37d69902 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:18.469250 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-863810ff-8d83-42ff-b02e-e129678aaa22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:18.470491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-863810ff-8d83-42ff-b02e-e129678aaa22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:18.471133 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-863810ff-8d83-42ff-b02e-e129678aaa22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:18.472053 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-863810ff-8d83-42ff-b02e-e129678aaa22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:18.472676 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-863810ff-8d83-42ff-b02e-e129678aaa22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:18.473603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-863810ff-8d83-42ff-b02e-e129678aaa22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:18.502076 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=24 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:52:18.644185 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-13442e66-82b9-4333-9e55-e04a37d69902 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204470 Aug 26 15:52:18.644992 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 137/270] 10.222.0.98 () {58 vars in 1275 bytes} [Fri Aug 26 15:52:18 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:52:18.662581 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-863810ff-8d83-42ff-b02e-e129678aaa22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:18.672436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-863810ff-8d83-42ff-b02e-e129678aaa22 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.227571 Aug 26 15:52:18.673016 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 134/271] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:18 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:52:19.301987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c0ca2098-bea7-4807-b566-e5a54b17bad1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:19.302687 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c0ca2098-bea7-4807-b566-e5a54b17bad1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:19.311214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0ca2098-bea7-4807-b566-e5a54b17bad1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:19.314416 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0ca2098-bea7-4807-b566-e5a54b17bad1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:19.315058 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0ca2098-bea7-4807-b566-e5a54b17bad1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:19.316192 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0ca2098-bea7-4807-b566-e5a54b17bad1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:19.316867 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0ca2098-bea7-4807-b566-e5a54b17bad1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:19.317478 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0ca2098-bea7-4807-b566-e5a54b17bad1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:19.693540 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c823f786-350b-4ac7-843a-48b5c4f1ace8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:19.694579 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c823f786-350b-4ac7-843a-48b5c4f1ace8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:19.705743 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c823f786-350b-4ac7-843a-48b5c4f1ace8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:19.706435 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c823f786-350b-4ac7-843a-48b5c4f1ace8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:19.707179 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c823f786-350b-4ac7-843a-48b5c4f1ace8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:19.708110 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c823f786-350b-4ac7-843a-48b5c4f1ace8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:19.708719 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c823f786-350b-4ac7-843a-48b5c4f1ace8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:19.709299 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c823f786-350b-4ac7-843a-48b5c4f1ace8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:19.861969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c823f786-350b-4ac7-843a-48b5c4f1ace8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:19.870187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c823f786-350b-4ac7-843a-48b5c4f1ace8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.180428 Aug 26 15:52:19.870867 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 135/272] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:19 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:52:20.076576 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c0ca2098-bea7-4807-b566-e5a54b17bad1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:20.088413 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c0ca2098-bea7-4807-b566-e5a54b17bad1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.790465 Aug 26 15:52:20.092372 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 138/273] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:19 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:20.892075 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a75e7ccf-08cc-4a2e-80aa-d878dafb7e4c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:20.893425 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a75e7ccf-08cc-4a2e-80aa-d878dafb7e4c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:20.900182 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a75e7ccf-08cc-4a2e-80aa-d878dafb7e4c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:20.900928 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a75e7ccf-08cc-4a2e-80aa-d878dafb7e4c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:20.901544 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a75e7ccf-08cc-4a2e-80aa-d878dafb7e4c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:20.902448 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a75e7ccf-08cc-4a2e-80aa-d878dafb7e4c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:20.906291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a75e7ccf-08cc-4a2e-80aa-d878dafb7e4c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:20.907131 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a75e7ccf-08cc-4a2e-80aa-d878dafb7e4c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:21.064536 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a75e7ccf-08cc-4a2e-80aa-d878dafb7e4c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:21.073340 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a75e7ccf-08cc-4a2e-80aa-d878dafb7e4c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.185508 Aug 26 15:52:21.074486 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 136/274] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:20 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:21.114606 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-97545f0a-5829-4461-a37d-d642394f0418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:21.119038 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-97545f0a-5829-4461-a37d-d642394f0418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:21.123087 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-97545f0a-5829-4461-a37d-d642394f0418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:21.123583 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-97545f0a-5829-4461-a37d-d642394f0418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:21.124832 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-97545f0a-5829-4461-a37d-d642394f0418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:21.125556 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-97545f0a-5829-4461-a37d-d642394f0418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:21.126013 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-97545f0a-5829-4461-a37d-d642394f0418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:21.126620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-97545f0a-5829-4461-a37d-d642394f0418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:21.371581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-97545f0a-5829-4461-a37d-d642394f0418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:21.390139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-97545f0a-5829-4461-a37d-d642394f0418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.280421 Aug 26 15:52:21.404862 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 139/275] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:21 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:21.409844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-dc521a24-441b-4dd5-a6e4-b47cc4b61a37 req-8786185f-0211-4a43-ada6-7b05ef590c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "241a08df-4027-4153-8284-9ef744c15cb5", "tag": "9978d447-2f15-4512-9675-bfc09607f200"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:21.426695 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-dc521a24-441b-4dd5-a6e4-b47cc4b61a37 req-8786185f-0211-4a43-ada6-7b05ef590c2c service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:21.427180 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-dc521a24-441b-4dd5-a6e4-b47cc4b61a37 req-8786185f-0211-4a43-ada6-7b05ef590c2c service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:21.429978 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-dc521a24-441b-4dd5-a6e4-b47cc4b61a37 req-8786185f-0211-4a43-ada6-7b05ef590c2c service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:21.449732 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-dc521a24-441b-4dd5-a6e4-b47cc4b61a37 req-8786185f-0211-4a43-ada6-7b05ef590c2c service nova] Creating event network-changed:9978d447-2f15-4512-9675-bfc09607f200 for instance 241a08df-4027-4153-8284-9ef744c15cb5 on hv-cinder-83124 Aug 26 15:52:21.454931 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-dc521a24-441b-4dd5-a6e4-b47cc4b61a37 req-8786185f-0211-4a43-ada6-7b05ef590c2c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049057 Aug 26 15:52:21.456340 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 137/276] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:52:22.095835 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-6d1402b0-9950-4549-95d9-8813da70f4b8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:22.096547 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-6d1402b0-9950-4549-95d9-8813da70f4b8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:22.111465 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6d1402b0-9950-4549-95d9-8813da70f4b8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:22.111984 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6d1402b0-9950-4549-95d9-8813da70f4b8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:22.113190 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6d1402b0-9950-4549-95d9-8813da70f4b8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:22.113916 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6d1402b0-9950-4549-95d9-8813da70f4b8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:22.115145 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6d1402b0-9950-4549-95d9-8813da70f4b8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:22.116588 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6d1402b0-9950-4549-95d9-8813da70f4b8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:22.358450 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-6d1402b0-9950-4549-95d9-8813da70f4b8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:22.372999 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-6d1402b0-9950-4549-95d9-8813da70f4b8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.282055 Aug 26 15:52:22.376276 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 140/277] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:22 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:22.418368 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-91359a4d-ccbb-4dc0-9438-4186bbc75d5c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:22.419829 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-91359a4d-ccbb-4dc0-9438-4186bbc75d5c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:22.428671 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-91359a4d-ccbb-4dc0-9438-4186bbc75d5c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:22.429269 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-91359a4d-ccbb-4dc0-9438-4186bbc75d5c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:22.429874 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-91359a4d-ccbb-4dc0-9438-4186bbc75d5c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:22.430866 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-91359a4d-ccbb-4dc0-9438-4186bbc75d5c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:22.431502 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-91359a4d-ccbb-4dc0-9438-4186bbc75d5c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:22.431773 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-91359a4d-ccbb-4dc0-9438-4186bbc75d5c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:22.673982 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-91359a4d-ccbb-4dc0-9438-4186bbc75d5c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:22.683908 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-91359a4d-ccbb-4dc0-9438-4186bbc75d5c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.275238 Aug 26 15:52:22.684740 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 138/278] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:22 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:23.394909 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-41e16c25-37d4-4708-81ca-2241a73d442c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:23.396009 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-41e16c25-37d4-4708-81ca-2241a73d442c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:23.402006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41e16c25-37d4-4708-81ca-2241a73d442c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:23.402491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41e16c25-37d4-4708-81ca-2241a73d442c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:23.402919 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41e16c25-37d4-4708-81ca-2241a73d442c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:23.403602 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41e16c25-37d4-4708-81ca-2241a73d442c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:23.404084 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41e16c25-37d4-4708-81ca-2241a73d442c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:23.404500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41e16c25-37d4-4708-81ca-2241a73d442c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:23.671248 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-41e16c25-37d4-4708-81ca-2241a73d442c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:23.684314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-41e16c25-37d4-4708-81ca-2241a73d442c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.293611 Aug 26 15:52:23.684921 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 141/279] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:23 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:23.707051 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6d213ed0-758a-4dbe-89a3-e1f0cf6e31d1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:23.707688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6d213ed0-758a-4dbe-89a3-e1f0cf6e31d1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:23.715136 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6d213ed0-758a-4dbe-89a3-e1f0cf6e31d1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:23.715636 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6d213ed0-758a-4dbe-89a3-e1f0cf6e31d1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:23.716235 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6d213ed0-758a-4dbe-89a3-e1f0cf6e31d1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:23.716846 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6d213ed0-758a-4dbe-89a3-e1f0cf6e31d1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:23.717319 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6d213ed0-758a-4dbe-89a3-e1f0cf6e31d1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:23.717728 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6d213ed0-758a-4dbe-89a3-e1f0cf6e31d1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:23.885369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6d213ed0-758a-4dbe-89a3-e1f0cf6e31d1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:23.909351 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6d213ed0-758a-4dbe-89a3-e1f0cf6e31d1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.207284 Aug 26 15:52:23.910433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 139/280] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:23 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:24.707930 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7b8658e8-6197-4670-9f8f-21f84af75b55 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:24.707930 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7b8658e8-6197-4670-9f8f-21f84af75b55 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:24.713177 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b8658e8-6197-4670-9f8f-21f84af75b55 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:24.713669 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b8658e8-6197-4670-9f8f-21f84af75b55 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:24.714129 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b8658e8-6197-4670-9f8f-21f84af75b55 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:24.714822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b8658e8-6197-4670-9f8f-21f84af75b55 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:24.715269 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b8658e8-6197-4670-9f8f-21f84af75b55 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:24.715699 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b8658e8-6197-4670-9f8f-21f84af75b55 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:24.931542 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-ee0115cc-4004-4517-b0b8-fcaba01e65aa tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:24.932789 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ee0115cc-4004-4517-b0b8-fcaba01e65aa tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:24.940246 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=62 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:52:24.941976 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ee0115cc-4004-4517-b0b8-fcaba01e65aa tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:24.942643 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ee0115cc-4004-4517-b0b8-fcaba01e65aa tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:24.943262 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ee0115cc-4004-4517-b0b8-fcaba01e65aa tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:24.944403 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ee0115cc-4004-4517-b0b8-fcaba01e65aa tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:24.945217 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ee0115cc-4004-4517-b0b8-fcaba01e65aa tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:24.945990 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ee0115cc-4004-4517-b0b8-fcaba01e65aa tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:25.069638 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7b8658e8-6197-4670-9f8f-21f84af75b55 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:25.082230 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7b8658e8-6197-4670-9f8f-21f84af75b55 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.379650 Aug 26 15:52:25.084195 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 142/281] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:24 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:25.141639 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ee0115cc-4004-4517-b0b8-fcaba01e65aa tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:25.162165 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-ee0115cc-4004-4517-b0b8-fcaba01e65aa tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.234552 Aug 26 15:52:25.182722 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 140/282] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:24 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:52:26.104894 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0e4c4710-f621-4dbf-8668-1d4a416646be tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:26.105671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0e4c4710-f621-4dbf-8668-1d4a416646be tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:26.113430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0e4c4710-f621-4dbf-8668-1d4a416646be tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:26.114412 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0e4c4710-f621-4dbf-8668-1d4a416646be tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:26.114677 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0e4c4710-f621-4dbf-8668-1d4a416646be tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:26.115666 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0e4c4710-f621-4dbf-8668-1d4a416646be tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:26.116391 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0e4c4710-f621-4dbf-8668-1d4a416646be tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:26.117140 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0e4c4710-f621-4dbf-8668-1d4a416646be tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:26.201456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7e2ec3b3-4e9b-41d7-801c-e9569fad0cdf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:26.202674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7e2ec3b3-4e9b-41d7-801c-e9569fad0cdf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:26.209836 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7e2ec3b3-4e9b-41d7-801c-e9569fad0cdf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:26.210251 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7e2ec3b3-4e9b-41d7-801c-e9569fad0cdf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:26.210689 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7e2ec3b3-4e9b-41d7-801c-e9569fad0cdf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:26.211400 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7e2ec3b3-4e9b-41d7-801c-e9569fad0cdf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:26.211859 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7e2ec3b3-4e9b-41d7-801c-e9569fad0cdf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:26.212321 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7e2ec3b3-4e9b-41d7-801c-e9569fad0cdf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:26.269860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0e4c4710-f621-4dbf-8668-1d4a416646be tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:26.279023 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0e4c4710-f621-4dbf-8668-1d4a416646be tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.178955 Aug 26 15:52:26.279617 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 143/283] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:26 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:26.351628 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7e2ec3b3-4e9b-41d7-801c-e9569fad0cdf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:26.360709 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7e2ec3b3-4e9b-41d7-801c-e9569fad0cdf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.163566 Aug 26 15:52:26.363607 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 141/284] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:26 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:52:27.302195 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b43e4d64-c27f-4ff3-8a4f-fed04ac5a76b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:27.303414 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b43e4d64-c27f-4ff3-8a4f-fed04ac5a76b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:27.310271 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b43e4d64-c27f-4ff3-8a4f-fed04ac5a76b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:27.310833 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b43e4d64-c27f-4ff3-8a4f-fed04ac5a76b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:27.311296 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b43e4d64-c27f-4ff3-8a4f-fed04ac5a76b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:27.312004 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b43e4d64-c27f-4ff3-8a4f-fed04ac5a76b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:27.313033 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b43e4d64-c27f-4ff3-8a4f-fed04ac5a76b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:27.315345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b43e4d64-c27f-4ff3-8a4f-fed04ac5a76b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:27.383094 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d102446a-a49d-4a94-b6da-3d0003d66925 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:27.383711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d102446a-a49d-4a94-b6da-3d0003d66925 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:27.391100 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d102446a-a49d-4a94-b6da-3d0003d66925 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:27.391820 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d102446a-a49d-4a94-b6da-3d0003d66925 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:27.392451 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d102446a-a49d-4a94-b6da-3d0003d66925 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:27.393184 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d102446a-a49d-4a94-b6da-3d0003d66925 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:27.393619 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d102446a-a49d-4a94-b6da-3d0003d66925 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:27.394198 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d102446a-a49d-4a94-b6da-3d0003d66925 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:27.567426 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d102446a-a49d-4a94-b6da-3d0003d66925 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:27.577890 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d102446a-a49d-4a94-b6da-3d0003d66925 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.199371 Aug 26 15:52:27.579072 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 142/285] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:27 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:27.764866 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-b43e4d64-c27f-4ff3-8a4f-fed04ac5a76b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:27.780583 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-b43e4d64-c27f-4ff3-8a4f-fed04ac5a76b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.482101 Aug 26 15:52:27.781736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 144/286] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:27 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:28.599038 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5ad4beeb-5e38-4377-b086-14cb3ab0a58a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:28.600333 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5ad4beeb-5e38-4377-b086-14cb3ab0a58a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:28.606857 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5ad4beeb-5e38-4377-b086-14cb3ab0a58a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:28.607572 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5ad4beeb-5e38-4377-b086-14cb3ab0a58a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:28.608393 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5ad4beeb-5e38-4377-b086-14cb3ab0a58a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:28.609267 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5ad4beeb-5e38-4377-b086-14cb3ab0a58a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:28.609934 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5ad4beeb-5e38-4377-b086-14cb3ab0a58a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:28.610274 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5ad4beeb-5e38-4377-b086-14cb3ab0a58a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:28.769987 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5ad4beeb-5e38-4377-b086-14cb3ab0a58a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:28.778896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5ad4beeb-5e38-4377-b086-14cb3ab0a58a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.183971 Aug 26 15:52:28.779493 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 143/287] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:28 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:28.802135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-87bc30a7-3f76-443a-ba5a-93492a4d0de0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:28.803357 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-87bc30a7-3f76-443a-ba5a-93492a4d0de0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:28.811707 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-87bc30a7-3f76-443a-ba5a-93492a4d0de0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:28.812485 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-87bc30a7-3f76-443a-ba5a-93492a4d0de0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:28.812941 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-87bc30a7-3f76-443a-ba5a-93492a4d0de0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:28.814070 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-87bc30a7-3f76-443a-ba5a-93492a4d0de0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:28.814551 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-87bc30a7-3f76-443a-ba5a-93492a4d0de0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:28.814920 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-87bc30a7-3f76-443a-ba5a-93492a4d0de0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:28.977795 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-87bc30a7-3f76-443a-ba5a-93492a4d0de0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:28.986158 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-87bc30a7-3f76-443a-ba5a-93492a4d0de0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.187936 Aug 26 15:52:28.986783 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 145/288] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:28 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:29.185843 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-dc17cc4d-61e0-4e7c-a859-e8fdc9cdf19c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Action: 'create', calling method: .version_select at 0x7fbd1e6b7a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-764795854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa2tnsVA232ExZG1VVdNjvKbGv8LGnxuwvnQQkfQlTo4O235Orb+1dLGqayhakJX3G0A+YSd0hm1lutm/vLDTjyppUj0y1V2usEWg0V+7Yn+WVXosppAs2lrF1XK5C2Gw=="}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:29.209296 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-dc17cc4d-61e0-4e7c-a859-e8fdc9cdf19c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Getting quotas for project d19b01b0af6c43feb357799d8ae948e1. Resources: {'key_pairs'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:52:29.214197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-dc17cc4d-61e0-4e7c-a859-e8fdc9cdf19c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Getting quotas for user 436adf49f3e24e03971017ea6dd33ac8 and project d19b01b0af6c43feb357799d8ae948e1. Resources: {'key_pairs'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:52:29.337191 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-dc17cc4d-61e0-4e7c-a859-e8fdc9cdf19c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.352588 Aug 26 15:52:29.337799 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 144/289] 10.222.0.98 () {60 vars in 1159 bytes} [Fri Aug 26 15:52:28 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:52:29.800301 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8472ee67-d3fe-4cbc-9fc2-9a9c3945b329 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:29.801116 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-8472ee67-d3fe-4cbc-9fc2-9a9c3945b329 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:29.807476 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8472ee67-d3fe-4cbc-9fc2-9a9c3945b329 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:29.808322 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8472ee67-d3fe-4cbc-9fc2-9a9c3945b329 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:29.808481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8472ee67-d3fe-4cbc-9fc2-9a9c3945b329 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:29.809358 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8472ee67-d3fe-4cbc-9fc2-9a9c3945b329 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:29.809809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8472ee67-d3fe-4cbc-9fc2-9a9c3945b329 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:29.810222 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8472ee67-d3fe-4cbc-9fc2-9a9c3945b329 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:29.963655 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8472ee67-d3fe-4cbc-9fc2-9a9c3945b329 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:29.972800 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-8472ee67-d3fe-4cbc-9fc2-9a9c3945b329 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.176994 Aug 26 15:52:29.973367 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 146/290] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:29 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:30.008176 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9e603d81-bd50-42e0-8927-0bde287f1183 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:30.008793 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9e603d81-bd50-42e0-8927-0bde287f1183 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:30.015744 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9e603d81-bd50-42e0-8927-0bde287f1183 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:30.016271 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9e603d81-bd50-42e0-8927-0bde287f1183 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:30.016701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9e603d81-bd50-42e0-8927-0bde287f1183 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:30.017401 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9e603d81-bd50-42e0-8927-0bde287f1183 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:30.018039 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9e603d81-bd50-42e0-8927-0bde287f1183 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:30.018492 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9e603d81-bd50-42e0-8927-0bde287f1183 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:30.150465 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9e603d81-bd50-42e0-8927-0bde287f1183 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:30.162850 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9e603d81-bd50-42e0-8927-0bde287f1183 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.158935 Aug 26 15:52:30.163471 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 145/291] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:30 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:30.997946 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-200fc77d-6fdc-41cc-8978-6ee9f53b57de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:30.998550 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-200fc77d-6fdc-41cc-8978-6ee9f53b57de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:31.005206 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-200fc77d-6fdc-41cc-8978-6ee9f53b57de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:31.005892 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-200fc77d-6fdc-41cc-8978-6ee9f53b57de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:31.006323 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-200fc77d-6fdc-41cc-8978-6ee9f53b57de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:31.007016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-200fc77d-6fdc-41cc-8978-6ee9f53b57de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:31.007602 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-200fc77d-6fdc-41cc-8978-6ee9f53b57de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:31.007966 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-200fc77d-6fdc-41cc-8978-6ee9f53b57de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:31.177163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-200fc77d-6fdc-41cc-8978-6ee9f53b57de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:31.185464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-086e25a0-30a9-45f2-a774-dc18e1af5821 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:31.186296 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-086e25a0-30a9-45f2-a774-dc18e1af5821 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:31.189169 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-200fc77d-6fdc-41cc-8978-6ee9f53b57de tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.194797 Aug 26 15:52:31.189755 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 147/292] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:30 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:31.193390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-086e25a0-30a9-45f2-a774-dc18e1af5821 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:31.193864 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-086e25a0-30a9-45f2-a774-dc18e1af5821 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:31.194295 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-086e25a0-30a9-45f2-a774-dc18e1af5821 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:31.194991 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-086e25a0-30a9-45f2-a774-dc18e1af5821 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:31.195435 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-086e25a0-30a9-45f2-a774-dc18e1af5821 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:31.195856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-086e25a0-30a9-45f2-a774-dc18e1af5821 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:31.356742 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-086e25a0-30a9-45f2-a774-dc18e1af5821 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:31.367155 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-086e25a0-30a9-45f2-a774-dc18e1af5821 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.186379 Aug 26 15:52:31.379344 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 146/293] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:31 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:31.914065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-4cba0f53-fc65-442e-870b-ee47d27d20a6 req-afe46e0b-5d62-4a1e-9620-53cb1f7ec2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d976c8-85c3-48de-80ba-93fdff79445a", "name": "network-vif-plugged", "status": "completed", "tag": "c5172524-b071-4da7-93f1-8465faf155b2"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:31.925390 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-4cba0f53-fc65-442e-870b-ee47d27d20a6 req-afe46e0b-5d62-4a1e-9620-53cb1f7ec2bb service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:31.926173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-4cba0f53-fc65-442e-870b-ee47d27d20a6 req-afe46e0b-5d62-4a1e-9620-53cb1f7ec2bb service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:31.926805 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-4cba0f53-fc65-442e-870b-ee47d27d20a6 req-afe46e0b-5d62-4a1e-9620-53cb1f7ec2bb service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:31.943039 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-4cba0f53-fc65-442e-870b-ee47d27d20a6 req-afe46e0b-5d62-4a1e-9620-53cb1f7ec2bb service nova] Creating event network-vif-plugged:c5172524-b071-4da7-93f1-8465faf155b2 for instance 08d976c8-85c3-48de-80ba-93fdff79445a on hv-cinder-83124 Aug 26 15:52:31.948226 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-4cba0f53-fc65-442e-870b-ee47d27d20a6 req-afe46e0b-5d62-4a1e-9620-53cb1f7ec2bb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040934 Aug 26 15:52:31.949597 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 148/294] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:52:32.211302 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e650cd93-04c6-4396-8aa6-e315cd5a6dd9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:32.212495 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e650cd93-04c6-4396-8aa6-e315cd5a6dd9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:32.221545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e650cd93-04c6-4396-8aa6-e315cd5a6dd9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:32.222067 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e650cd93-04c6-4396-8aa6-e315cd5a6dd9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:32.222505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e650cd93-04c6-4396-8aa6-e315cd5a6dd9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:32.223211 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e650cd93-04c6-4396-8aa6-e315cd5a6dd9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:32.223658 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e650cd93-04c6-4396-8aa6-e315cd5a6dd9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:32.224104 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e650cd93-04c6-4396-8aa6-e315cd5a6dd9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:32.366608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e650cd93-04c6-4396-8aa6-e315cd5a6dd9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:32.375363 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e650cd93-04c6-4396-8aa6-e315cd5a6dd9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.168247 Aug 26 15:52:32.375969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 147/295] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:32 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:32.390102 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-45e057de-8f0b-4710-8415-ad0cbdce8bf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:32.390978 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-45e057de-8f0b-4710-8415-ad0cbdce8bf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:32.397822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-45e057de-8f0b-4710-8415-ad0cbdce8bf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:32.398325 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-45e057de-8f0b-4710-8415-ad0cbdce8bf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:32.399029 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-45e057de-8f0b-4710-8415-ad0cbdce8bf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:32.399603 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-45e057de-8f0b-4710-8415-ad0cbdce8bf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:32.400089 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-45e057de-8f0b-4710-8415-ad0cbdce8bf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:32.400866 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-45e057de-8f0b-4710-8415-ad0cbdce8bf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:32.650743 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-45e057de-8f0b-4710-8415-ad0cbdce8bf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:32.660377 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-45e057de-8f0b-4710-8415-ad0cbdce8bf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.274941 Aug 26 15:52:32.660955 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 149/296] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:32 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:33.398824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-21e19dae-cc62-4090-ae76-f180b059ea2a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:33.399580 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-21e19dae-cc62-4090-ae76-f180b059ea2a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:33.406813 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-21e19dae-cc62-4090-ae76-f180b059ea2a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:33.407638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-21e19dae-cc62-4090-ae76-f180b059ea2a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:33.408441 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-21e19dae-cc62-4090-ae76-f180b059ea2a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:33.409382 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-21e19dae-cc62-4090-ae76-f180b059ea2a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:33.410000 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-21e19dae-cc62-4090-ae76-f180b059ea2a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:33.410583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-21e19dae-cc62-4090-ae76-f180b059ea2a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:33.602964 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-21e19dae-cc62-4090-ae76-f180b059ea2a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:33.618728 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-21e19dae-cc62-4090-ae76-f180b059ea2a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.223870 Aug 26 15:52:33.619743 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 148/297] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:33 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:33.683004 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-05cab721-f9d8-40c0-bfb8-33c7e486d0ad tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:33.684102 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-05cab721-f9d8-40c0-bfb8-33c7e486d0ad tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:33.690741 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-05cab721-f9d8-40c0-bfb8-33c7e486d0ad tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:33.691227 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-05cab721-f9d8-40c0-bfb8-33c7e486d0ad tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:33.691667 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-05cab721-f9d8-40c0-bfb8-33c7e486d0ad tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:33.692406 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-05cab721-f9d8-40c0-bfb8-33c7e486d0ad tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:33.693006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-05cab721-f9d8-40c0-bfb8-33c7e486d0ad tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:33.693439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-05cab721-f9d8-40c0-bfb8-33c7e486d0ad tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:33.854301 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-05cab721-f9d8-40c0-bfb8-33c7e486d0ad tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:33.863629 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-05cab721-f9d8-40c0-bfb8-33c7e486d0ad tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1371 microversion: 2.1 time: 0.185726 Aug 26 15:52:33.866441 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 150/298] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:33 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:34.641289 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-8716f65e-c086-47ec-90f2-c049c96cd08d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:34.642424 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-8716f65e-c086-47ec-90f2-c049c96cd08d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:34.649197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8716f65e-c086-47ec-90f2-c049c96cd08d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:34.654048 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8716f65e-c086-47ec-90f2-c049c96cd08d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:34.654048 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8716f65e-c086-47ec-90f2-c049c96cd08d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:34.654048 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8716f65e-c086-47ec-90f2-c049c96cd08d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:34.654048 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8716f65e-c086-47ec-90f2-c049c96cd08d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:34.654378 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8716f65e-c086-47ec-90f2-c049c96cd08d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:34.804783 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-8716f65e-c086-47ec-90f2-c049c96cd08d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:34.814342 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-8716f65e-c086-47ec-90f2-c049c96cd08d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1722 microversion: 2.1 time: 0.176998 Aug 26 15:52:34.814911 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 149/299] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:34 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:34.895856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b4cd1aa4-9f58-4b6b-a71b-4768f8df6d2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:34.896646 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b4cd1aa4-9f58-4b6b-a71b-4768f8df6d2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:34.905407 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b4cd1aa4-9f58-4b6b-a71b-4768f8df6d2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:34.905407 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b4cd1aa4-9f58-4b6b-a71b-4768f8df6d2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:34.905407 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b4cd1aa4-9f58-4b6b-a71b-4768f8df6d2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:34.905407 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b4cd1aa4-9f58-4b6b-a71b-4768f8df6d2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:34.905786 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b4cd1aa4-9f58-4b6b-a71b-4768f8df6d2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:34.905877 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b4cd1aa4-9f58-4b6b-a71b-4768f8df6d2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:34.927405 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=100 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:52:35.083016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-b4cd1aa4-9f58-4b6b-a71b-4768f8df6d2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:35.091745 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-b4cd1aa4-9f58-4b6b-a71b-4768f8df6d2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1566 microversion: 2.1 time: 0.199101 Aug 26 15:52:35.092408 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 151/300] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:34 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:35.113166 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1c9b73b9-e2e0-4e6b-aefb-749447d08931 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:35.113654 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1c9b73b9-e2e0-4e6b-aefb-749447d08931 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:35.119565 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1c9b73b9-e2e0-4e6b-aefb-749447d08931 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:35.120112 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1c9b73b9-e2e0-4e6b-aefb-749447d08931 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:35.120591 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1c9b73b9-e2e0-4e6b-aefb-749447d08931 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:35.121219 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1c9b73b9-e2e0-4e6b-aefb-749447d08931 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:35.121664 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1c9b73b9-e2e0-4e6b-aefb-749447d08931 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:35.122192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1c9b73b9-e2e0-4e6b-aefb-749447d08931 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:35.202921 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1c9b73b9-e2e0-4e6b-aefb-749447d08931 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094279 Aug 26 15:52:35.203545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 150/301] 10.222.0.98 () {58 vars in 1275 bytes} [Fri Aug 26 15:52:35 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:52:35.835009 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-fee298c4-c15b-4a08-8b6e-87834a85edc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:35.835613 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-fee298c4-c15b-4a08-8b6e-87834a85edc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:35.841640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fee298c4-c15b-4a08-8b6e-87834a85edc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:35.842109 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fee298c4-c15b-4a08-8b6e-87834a85edc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:35.842532 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fee298c4-c15b-4a08-8b6e-87834a85edc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:35.843215 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fee298c4-c15b-4a08-8b6e-87834a85edc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:35.843793 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fee298c4-c15b-4a08-8b6e-87834a85edc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:35.844742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fee298c4-c15b-4a08-8b6e-87834a85edc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:36.054562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-fee298c4-c15b-4a08-8b6e-87834a85edc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:36.063543 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-fee298c4-c15b-4a08-8b6e-87834a85edc5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1699 microversion: 2.1 time: 0.232313 Aug 26 15:52:36.064408 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 152/302] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:35 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1699 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:36.086482 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b57a2c0c-6511-4585-80dd-2a3cd2d049cf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:36.093329 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b57a2c0c-6511-4585-80dd-2a3cd2d049cf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:36.093852 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b57a2c0c-6511-4585-80dd-2a3cd2d049cf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:36.094488 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b57a2c0c-6511-4585-80dd-2a3cd2d049cf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:36.118608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b57a2c0c-6511-4585-80dd-2a3cd2d049cf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Going to try to start instance {{(pid=127697) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 15:52:36.137244 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=100 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:52:36.416551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b57a2c0c-6511-4585-80dd-2a3cd2d049cf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "POST /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/action" status: 202 len: 0 microversion: 2.1 time: 0.334465 Aug 26 15:52:36.417229 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 151/303] 10.222.0.98 () {60 vars in 1278 bytes} [Fri Aug 26 15:52:36 2022] POST /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:52:36.426234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d39c3237-cb44-4b57-8cbd-b76f954dac0d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:36.427136 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d39c3237-cb44-4b57-8cbd-b76f954dac0d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:36.434697 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d39c3237-cb44-4b57-8cbd-b76f954dac0d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:36.435409 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d39c3237-cb44-4b57-8cbd-b76f954dac0d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:36.435842 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d39c3237-cb44-4b57-8cbd-b76f954dac0d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:36.436759 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d39c3237-cb44-4b57-8cbd-b76f954dac0d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:36.437432 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d39c3237-cb44-4b57-8cbd-b76f954dac0d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:36.438378 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d39c3237-cb44-4b57-8cbd-b76f954dac0d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:36.562496 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-7997135f-f880-4b6c-bb98-a0eb4c4d233f req-ef732d5f-6cc4-4730-a3de-a5168e9a15e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d976c8-85c3-48de-80ba-93fdff79445a", "tag": "c5172524-b071-4da7-93f1-8465faf155b2"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:36.586932 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-7997135f-f880-4b6c-bb98-a0eb4c4d233f req-ef732d5f-6cc4-4730-a3de-a5168e9a15e4 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:36.587418 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-7997135f-f880-4b6c-bb98-a0eb4c4d233f req-ef732d5f-6cc4-4730-a3de-a5168e9a15e4 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:36.588033 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-7997135f-f880-4b6c-bb98-a0eb4c4d233f req-ef732d5f-6cc4-4730-a3de-a5168e9a15e4 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:36.606745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-7997135f-f880-4b6c-bb98-a0eb4c4d233f req-ef732d5f-6cc4-4730-a3de-a5168e9a15e4 service nova] Creating event network-changed:c5172524-b071-4da7-93f1-8465faf155b2 for instance 08d976c8-85c3-48de-80ba-93fdff79445a on hv-cinder-83124 Aug 26 15:52:36.613756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-7997135f-f880-4b6c-bb98-a0eb4c4d233f req-ef732d5f-6cc4-4730-a3de-a5168e9a15e4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059832 Aug 26 15:52:36.615267 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 152/304] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:52:36.679197 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d39c3237-cb44-4b57-8cbd-b76f954dac0d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:36.698358 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d39c3237-cb44-4b57-8cbd-b76f954dac0d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1708 microversion: 2.1 time: 0.276204 Aug 26 15:52:36.699338 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 153/305] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:36 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1708 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:37.736219 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-245fc875-cb3f-4f39-88f6-e9031a9d3dfb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:37.737319 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-245fc875-cb3f-4f39-88f6-e9031a9d3dfb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:37.747461 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-245fc875-cb3f-4f39-88f6-e9031a9d3dfb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:37.748874 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-245fc875-cb3f-4f39-88f6-e9031a9d3dfb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:37.750535 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-245fc875-cb3f-4f39-88f6-e9031a9d3dfb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:37.751494 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-245fc875-cb3f-4f39-88f6-e9031a9d3dfb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:37.752134 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-245fc875-cb3f-4f39-88f6-e9031a9d3dfb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:37.752676 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-245fc875-cb3f-4f39-88f6-e9031a9d3dfb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:37.918243 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-245fc875-cb3f-4f39-88f6-e9031a9d3dfb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:37.942103 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-245fc875-cb3f-4f39-88f6-e9031a9d3dfb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1708 microversion: 2.1 time: 0.212614 Aug 26 15:52:37.945641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 153/306] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:37 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1708 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:38.974884 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-74549b16-1638-45c3-ae90-7f5f41b3a913 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:38.975637 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-74549b16-1638-45c3-ae90-7f5f41b3a913 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:38.982487 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-74549b16-1638-45c3-ae90-7f5f41b3a913 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:38.982972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-74549b16-1638-45c3-ae90-7f5f41b3a913 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:38.983408 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-74549b16-1638-45c3-ae90-7f5f41b3a913 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:38.984137 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-74549b16-1638-45c3-ae90-7f5f41b3a913 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:38.984768 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-74549b16-1638-45c3-ae90-7f5f41b3a913 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:38.985195 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-74549b16-1638-45c3-ae90-7f5f41b3a913 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:39.118070 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-74549b16-1638-45c3-ae90-7f5f41b3a913 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:39.126974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-74549b16-1638-45c3-ae90-7f5f41b3a913 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1712 microversion: 2.1 time: 0.156866 Aug 26 15:52:39.131917 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 154/307] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:38 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1712 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:40.766544 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1092596142", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "networks": [{"uuid": "1d5138f4-1909-488f-bfaa-fb93ef1d71dc"}]}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:40.775220 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=4 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:52:42.152020 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-664509032", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452"}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:47.924331 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=10,nova_cell1:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:52:49.123028 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=20 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:52:50.777711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:52:51.726359 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.network.neutron [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] validate_networks() for [('1d5138f4-1909-488f-bfaa-fb93ef1d71dc', None, None, None, None, None)] {{(pid=127697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:52:51.739647 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.network.neutron [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] validate_networks() for None {{(pid=127698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:52:52.105042 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Flavor limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:52:52.105456 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Image limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:52:52.106024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Flavor pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:52:52.106425 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Image pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:52:52.106825 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:52:52.108864 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=42 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:52:52.116760 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:52.117249 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:52.117658 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:52.118377 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:52.118822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:52.119235 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:52.139298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Getting quotas for project 09d9df73d19f4955b822a056d9545a92. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:52:52.144218 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Getting quotas for user 1c179cd4dc6943419d793a1eb05dc0b5 and project 09d9df73d19f4955b822a056d9545a92. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:52:52.155390 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Going to run 1 instances... {{(pid=127698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:52:52.158375 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:52:52.189796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Flavor limits 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:52:52.190424 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Image limits 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:52:52.190684 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Flavor pref 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:52:52.191117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Image pref 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:52:52.191534 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:52:52.200371 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:52.200851 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:52.201284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:52.202048 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:52.202503 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:52.202927 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:52.221781 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Getting quotas for project 7e4bab21dc3141bd89ee2ea54fe0c14c. Resources: {'ram', 'cores', 'instances'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:52:52.226075 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Getting quotas for user 28436612400e421ca52f902542186a68 and project 7e4bab21dc3141bd89ee2ea54fe0c14c. Resources: {'ram', 'cores', 'instances'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:52:52.237301 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Going to run 1 instances... {{(pid=127697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:52:52.239611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:52:52.329978 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ab582018-01bb-45d9-ac7a-31bc8ce059ab tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.181220 Aug 26 15:52:52.330575 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 155/308] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:52:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 10183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 15:52:52.341239 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-fdf41d94-6211-4202-8aaa-b63098fc58b4 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:52.341847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-fdf41d94-6211-4202-8aaa-b63098fc58b4 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:52.361176 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6a876f18-28e8-468f-8143-6481236f90aa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.598889 Aug 26 15:52:52.361828 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 154/309] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:52:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 11600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:52:52.374418 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c7d0f4c8-c099-4131-b03b-4f2a68f88471 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:52.375245 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c7d0f4c8-c099-4131-b03b-4f2a68f88471 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:52.421975 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-fdf41d94-6211-4202-8aaa-b63098fc58b4 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:52.431299 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-fdf41d94-6211-4202-8aaa-b63098fc58b4 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1214 microversion: 2.1 time: 0.093797 Aug 26 15:52:52.431908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 156/310] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:52 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:52:52.445709 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c7d0f4c8-c099-4131-b03b-4f2a68f88471 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:52.452046 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c7d0f4c8-c099-4131-b03b-4f2a68f88471 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1219 microversion: 2.1 time: 0.082858 Aug 26 15:52:52.452826 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 155/311] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:52 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:53.452516 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-51039e32-dd1b-4f85-9935-7f3fbcbe4081 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:53.453131 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-51039e32-dd1b-4f85-9935-7f3fbcbe4081 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:53.473215 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-de4873cb-a281-4a75-848d-9cf7a4b06d13 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:53.474300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-de4873cb-a281-4a75-848d-9cf7a4b06d13 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:53.515662 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-51039e32-dd1b-4f85-9935-7f3fbcbe4081 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:53.524286 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-51039e32-dd1b-4f85-9935-7f3fbcbe4081 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1214 microversion: 2.1 time: 0.075613 Aug 26 15:52:53.535896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 157/312] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:53 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:53.536601 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-de4873cb-a281-4a75-848d-9cf7a4b06d13 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:53.541526 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-de4873cb-a281-4a75-848d-9cf7a4b06d13 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1219 microversion: 2.1 time: 0.072595 Aug 26 15:52:53.543378 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 156/313] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:53 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:54.546564 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-15abee99-38c8-45a3-bac3-362762dc304a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:54.547172 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-15abee99-38c8-45a3-bac3-362762dc304a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:54.553806 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15abee99-38c8-45a3-bac3-362762dc304a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:54.554401 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15abee99-38c8-45a3-bac3-362762dc304a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:54.554790 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15abee99-38c8-45a3-bac3-362762dc304a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:54.555494 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15abee99-38c8-45a3-bac3-362762dc304a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:54.557704 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15abee99-38c8-45a3-bac3-362762dc304a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:54.557704 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15abee99-38c8-45a3-bac3-362762dc304a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:54.562986 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-57b1cdf2-c297-4701-a0e5-b41c1b71558f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:54.563605 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-57b1cdf2-c297-4701-a0e5-b41c1b71558f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:54.572518 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57b1cdf2-c297-4701-a0e5-b41c1b71558f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:54.573029 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57b1cdf2-c297-4701-a0e5-b41c1b71558f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:54.573456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57b1cdf2-c297-4701-a0e5-b41c1b71558f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:54.574189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57b1cdf2-c297-4701-a0e5-b41c1b71558f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:54.580109 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57b1cdf2-c297-4701-a0e5-b41c1b71558f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:54.580555 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57b1cdf2-c297-4701-a0e5-b41c1b71558f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:54.645745 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-15abee99-38c8-45a3-bac3-362762dc304a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:54.654447 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-15abee99-38c8-45a3-bac3-362762dc304a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1210 microversion: 2.1 time: 0.111669 Aug 26 15:52:54.656392 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-57b1cdf2-c297-4701-a0e5-b41c1b71558f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:54.662693 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 158/314] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:54 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1210 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:54.665243 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-57b1cdf2-c297-4701-a0e5-b41c1b71558f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1215 microversion: 2.1 time: 0.106347 Aug 26 15:52:54.666056 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 157/315] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:54 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:52:55.676631 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-cf81778f-5799-4bda-940d-81d850931392 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:55.677234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-cf81778f-5799-4bda-940d-81d850931392 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:55.686078 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cf81778f-5799-4bda-940d-81d850931392 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:55.686078 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cf81778f-5799-4bda-940d-81d850931392 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:55.686078 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cf81778f-5799-4bda-940d-81d850931392 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:55.686078 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cf81778f-5799-4bda-940d-81d850931392 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:55.686501 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cf81778f-5799-4bda-940d-81d850931392 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:55.686501 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cf81778f-5799-4bda-940d-81d850931392 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:55.688925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5a5e9172-ebc3-4f0f-9a55-6556df5232a6 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:55.689870 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5a5e9172-ebc3-4f0f-9a55-6556df5232a6 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:55.696582 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a5e9172-ebc3-4f0f-9a55-6556df5232a6 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:55.697094 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a5e9172-ebc3-4f0f-9a55-6556df5232a6 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:55.697537 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a5e9172-ebc3-4f0f-9a55-6556df5232a6 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:55.698288 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a5e9172-ebc3-4f0f-9a55-6556df5232a6 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:55.698748 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a5e9172-ebc3-4f0f-9a55-6556df5232a6 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:55.699179 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a5e9172-ebc3-4f0f-9a55-6556df5232a6 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:55.748891 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-cf81778f-5799-4bda-940d-81d850931392 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:55.757107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-cf81778f-5799-4bda-940d-81d850931392 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1266 microversion: 2.1 time: 0.084998 Aug 26 15:52:55.757693 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 159/316] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:55 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:55.766865 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5a5e9172-ebc3-4f0f-9a55-6556df5232a6 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:55.775284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5a5e9172-ebc3-4f0f-9a55-6556df5232a6 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1271 microversion: 2.1 time: 0.090290 Aug 26 15:52:55.775854 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 158/317] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:55 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:52:56.780050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-42f7c637-da3f-47fa-a206-c2cf9fc2423a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:56.781000 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-42f7c637-da3f-47fa-a206-c2cf9fc2423a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:56.788731 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-42f7c637-da3f-47fa-a206-c2cf9fc2423a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:56.789227 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-42f7c637-da3f-47fa-a206-c2cf9fc2423a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:56.789888 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-42f7c637-da3f-47fa-a206-c2cf9fc2423a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:56.790976 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-42f7c637-da3f-47fa-a206-c2cf9fc2423a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:56.791660 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-42f7c637-da3f-47fa-a206-c2cf9fc2423a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:56.792273 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-42f7c637-da3f-47fa-a206-c2cf9fc2423a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:56.796556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c2a8b89f-c8f1-4402-8473-d813a82adb19 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:56.797176 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c2a8b89f-c8f1-4402-8473-d813a82adb19 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:56.810802 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c2a8b89f-c8f1-4402-8473-d813a82adb19 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:56.811808 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c2a8b89f-c8f1-4402-8473-d813a82adb19 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:56.812290 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c2a8b89f-c8f1-4402-8473-d813a82adb19 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:56.813185 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c2a8b89f-c8f1-4402-8473-d813a82adb19 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:56.813651 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c2a8b89f-c8f1-4402-8473-d813a82adb19 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:56.814088 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c2a8b89f-c8f1-4402-8473-d813a82adb19 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:57.028636 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-42f7c637-da3f-47fa-a206-c2cf9fc2423a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:57.045048 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-42f7c637-da3f-47fa-a206-c2cf9fc2423a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1272 microversion: 2.1 time: 0.270604 Aug 26 15:52:57.046646 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 160/318] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:56 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:57.053621 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c2a8b89f-c8f1-4402-8473-d813a82adb19 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:57.061598 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c2a8b89f-c8f1-4402-8473-d813a82adb19 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1319 microversion: 2.1 time: 0.268972 Aug 26 15:52:57.062266 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 159/319] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:56 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:57.933548 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-890263f5-1694-47a7-aed7-607d11c5fccb req-4dc9450d-a68f-4c2f-b168-b08930fb9b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33", "tag": "52d33e41-9211-4ad4-ac40-766f6c12c9d8"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:57.944941 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-890263f5-1694-47a7-aed7-607d11c5fccb req-4dc9450d-a68f-4c2f-b168-b08930fb9b09 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:57.945988 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-890263f5-1694-47a7-aed7-607d11c5fccb req-4dc9450d-a68f-4c2f-b168-b08930fb9b09 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:57.946593 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-890263f5-1694-47a7-aed7-607d11c5fccb req-4dc9450d-a68f-4c2f-b168-b08930fb9b09 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:57.958158 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-890263f5-1694-47a7-aed7-607d11c5fccb req-4dc9450d-a68f-4c2f-b168-b08930fb9b09 service nova] Creating event network-changed:52d33e41-9211-4ad4-ac40-766f6c12c9d8 for instance ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 on hv-cinder-83124 Aug 26 15:52:57.963443 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-890263f5-1694-47a7-aed7-607d11c5fccb req-4dc9450d-a68f-4c2f-b168-b08930fb9b09 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033394 Aug 26 15:52:57.964504 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 161/320] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:52:58.074057 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-75c07013-b719-485e-b07d-64b067852477 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:58.074765 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-75c07013-b719-485e-b07d-64b067852477 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:58.085150 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-fa78d421-5ea2-4954-8486-eb54e3ceb9d0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:58.086146 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-fa78d421-5ea2-4954-8486-eb54e3ceb9d0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:58.086339 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-75c07013-b719-485e-b07d-64b067852477 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:58.087263 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-75c07013-b719-485e-b07d-64b067852477 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:58.087958 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-75c07013-b719-485e-b07d-64b067852477 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:58.089800 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-75c07013-b719-485e-b07d-64b067852477 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:58.091569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-75c07013-b719-485e-b07d-64b067852477 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:58.092199 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-75c07013-b719-485e-b07d-64b067852477 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:58.093787 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fa78d421-5ea2-4954-8486-eb54e3ceb9d0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:58.094550 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fa78d421-5ea2-4954-8486-eb54e3ceb9d0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:58.095266 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fa78d421-5ea2-4954-8486-eb54e3ceb9d0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:58.097451 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fa78d421-5ea2-4954-8486-eb54e3ceb9d0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:58.098180 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fa78d421-5ea2-4954-8486-eb54e3ceb9d0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:58.099391 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fa78d421-5ea2-4954-8486-eb54e3ceb9d0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:58.326260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-75c07013-b719-485e-b07d-64b067852477 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:58.335328 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-fa78d421-5ea2-4954-8486-eb54e3ceb9d0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:58.343783 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-75c07013-b719-485e-b07d-64b067852477 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1314 microversion: 2.1 time: 0.272258 Aug 26 15:52:58.346509 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 160/321] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:58 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:58.354965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-fa78d421-5ea2-4954-8486-eb54e3ceb9d0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1319 microversion: 2.1 time: 0.275268 Aug 26 15:52:58.368400 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 162/322] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:58 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:58.507320 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-bedd9cb6-d4d3-4ca9-b998-6717608b4a8a req-43bc89e6-ef17-4941-a15a-ffacfe597eef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76fac001-d457-45b5-9479-98a195b7fae5", "tag": "029f9435-d874-4e82-8c5b-534e1fd3c3f4"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:58.517869 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-bedd9cb6-d4d3-4ca9-b998-6717608b4a8a req-43bc89e6-ef17-4941-a15a-ffacfe597eef service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:58.518633 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-bedd9cb6-d4d3-4ca9-b998-6717608b4a8a req-43bc89e6-ef17-4941-a15a-ffacfe597eef service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:58.519065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-bedd9cb6-d4d3-4ca9-b998-6717608b4a8a req-43bc89e6-ef17-4941-a15a-ffacfe597eef service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:58.530092 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-bedd9cb6-d4d3-4ca9-b998-6717608b4a8a req-43bc89e6-ef17-4941-a15a-ffacfe597eef service nova] Creating event network-changed:029f9435-d874-4e82-8c5b-534e1fd3c3f4 for instance 76fac001-d457-45b5-9479-98a195b7fae5 on hv-cinder-83124 Aug 26 15:52:58.535095 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-bedd9cb6-d4d3-4ca9-b998-6717608b4a8a req-43bc89e6-ef17-4941-a15a-ffacfe597eef service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031503 Aug 26 15:52:58.535977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 161/323] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:52:59.366924 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-23067b15-6f9c-4cab-80f7-12b229fad4c2 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:59.367591 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-23067b15-6f9c-4cab-80f7-12b229fad4c2 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:59.374304 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-23067b15-6f9c-4cab-80f7-12b229fad4c2 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:59.374910 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-23067b15-6f9c-4cab-80f7-12b229fad4c2 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:59.375438 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-23067b15-6f9c-4cab-80f7-12b229fad4c2 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:59.375971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-27f0587b-8414-4821-bfec-780f129868cf tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:52:59.376430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-23067b15-6f9c-4cab-80f7-12b229fad4c2 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:59.376717 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-27f0587b-8414-4821-bfec-780f129868cf tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:52:59.376991 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-23067b15-6f9c-4cab-80f7-12b229fad4c2 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:59.377509 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-23067b15-6f9c-4cab-80f7-12b229fad4c2 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:59.383290 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-27f0587b-8414-4821-bfec-780f129868cf tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:59.383712 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-27f0587b-8414-4821-bfec-780f129868cf tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:59.384171 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-27f0587b-8414-4821-bfec-780f129868cf tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:59.384866 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-27f0587b-8414-4821-bfec-780f129868cf tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:52:59.385320 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-27f0587b-8414-4821-bfec-780f129868cf tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:52:59.385747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-27f0587b-8414-4821-bfec-780f129868cf tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:52:59.521468 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-23067b15-6f9c-4cab-80f7-12b229fad4c2 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:59.529985 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-23067b15-6f9c-4cab-80f7-12b229fad4c2 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1314 microversion: 2.1 time: 0.166876 Aug 26 15:52:59.530560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 163/324] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:59 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:59.533616 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-27f0587b-8414-4821-bfec-780f129868cf tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:52:59.536728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-550774716", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-764795854", "security_groups": [{"name": "tempest-secgroup-smoke-605569295"}], "block_device_mapping_v2": [{"uuid": "d0280b9c-9115-471f-8fb3-4b068d1c9fe6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4908c59f-0bb1-43e0-b8ad-2ab3083c5d12"}]}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:52:59.541447 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-27f0587b-8414-4821-bfec-780f129868cf tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1319 microversion: 2.1 time: 0.170119 Aug 26 15:52:59.542009 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 162/325] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:52:59 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:52:59.647994 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.network.neutron [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] validate_networks() for [('4908c59f-0bb1-43e0-b8ad-2ab3083c5d12', None, None, None, None, None)] {{(pid=127698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:53:00.024546 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Flavor limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:53:00.024972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Image limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:53:00.025472 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Flavor pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:53:00.025884 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Image pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:53:00.026297 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:53:00.035149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:00.035627 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:00.036107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:00.036832 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:00.037288 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:00.037710 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:00.054340 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Getting quotas for project d19b01b0af6c43feb357799d8ae948e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:53:00.058299 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Getting quotas for user 436adf49f3e24e03971017ea6dd33ac8 and project d19b01b0af6c43feb357799d8ae948e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:53:00.116647 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Going to run 1 instances... {{(pid=127698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:53:00.118754 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d0280b9c-9115-471f-8fb3-4b068d1c9fe6',volume_size=None,volume_type=None)] {{(pid=127698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:53:00.551219 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-79d05587-d6a5-40ca-85fe-491b9479ed11 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:00.551898 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-79d05587-d6a5-40ca-85fe-491b9479ed11 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:00.558679 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-79d05587-d6a5-40ca-85fe-491b9479ed11 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:00.559172 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-79d05587-d6a5-40ca-85fe-491b9479ed11 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:00.559674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-79d05587-d6a5-40ca-85fe-491b9479ed11 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:00.560433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-79d05587-d6a5-40ca-85fe-491b9479ed11 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:00.560892 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-79d05587-d6a5-40ca-85fe-491b9479ed11 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:00.561349 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-79d05587-d6a5-40ca-85fe-491b9479ed11 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:00.605560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c0d50b12-9d08-46d1-8401-b0cfb4d5a0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.073004 Aug 26 15:53:00.606496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 164/326] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:52:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:53:00.611821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e625ae0c-c534-4744-b1ad-83280a737351 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:00.612809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e625ae0c-c534-4744-b1ad-83280a737351 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:00.620115 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e625ae0c-c534-4744-b1ad-83280a737351 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:00.620782 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e625ae0c-c534-4744-b1ad-83280a737351 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:00.621320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e625ae0c-c534-4744-b1ad-83280a737351 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:00.622126 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e625ae0c-c534-4744-b1ad-83280a737351 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:00.622821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e625ae0c-c534-4744-b1ad-83280a737351 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:00.623348 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e625ae0c-c534-4744-b1ad-83280a737351 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:00.740733 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-79d05587-d6a5-40ca-85fe-491b9479ed11 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:00.753592 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-79d05587-d6a5-40ca-85fe-491b9479ed11 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1314 microversion: 2.1 time: 0.206733 Aug 26 15:53:00.754581 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 163/327] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:00 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:00.759698 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-42cc594f-817d-4ed3-96b1-0c9c435a91c3 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:00.760411 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-42cc594f-817d-4ed3-96b1-0c9c435a91c3 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:00.772425 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e625ae0c-c534-4744-b1ad-83280a737351 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:00.780742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e625ae0c-c534-4744-b1ad-83280a737351 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1319 microversion: 2.1 time: 0.173248 Aug 26 15:53:00.781905 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 165/328] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:00 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:00.819320 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-42cc594f-817d-4ed3-96b1-0c9c435a91c3 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:00.826222 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-42cc594f-817d-4ed3-96b1-0c9c435a91c3 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1093 microversion: 2.1 time: 0.070349 Aug 26 15:53:00.826791 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 164/329] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:00 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:01.774389 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-66325bad-b239-474e-ad2f-efbbdd027341 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:01.775027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-66325bad-b239-474e-ad2f-efbbdd027341 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:01.781138 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66325bad-b239-474e-ad2f-efbbdd027341 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:01.781626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66325bad-b239-474e-ad2f-efbbdd027341 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:01.782062 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66325bad-b239-474e-ad2f-efbbdd027341 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:01.782874 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66325bad-b239-474e-ad2f-efbbdd027341 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:01.783332 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66325bad-b239-474e-ad2f-efbbdd027341 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:01.783760 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66325bad-b239-474e-ad2f-efbbdd027341 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:01.803600 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-37a22106-53e4-4150-a429-452d25c07964 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:01.804269 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-37a22106-53e4-4150-a429-452d25c07964 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:01.811081 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-37a22106-53e4-4150-a429-452d25c07964 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:01.812197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-37a22106-53e4-4150-a429-452d25c07964 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:01.812197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-37a22106-53e4-4150-a429-452d25c07964 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:01.812785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-37a22106-53e4-4150-a429-452d25c07964 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:01.813640 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-37a22106-53e4-4150-a429-452d25c07964 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:01.813640 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-37a22106-53e4-4150-a429-452d25c07964 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:01.942348 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-66325bad-b239-474e-ad2f-efbbdd027341 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:01.951139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-66325bad-b239-474e-ad2f-efbbdd027341 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1314 microversion: 2.1 time: 0.179783 Aug 26 15:53:01.952166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 166/330] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:01 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:01.956156 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f7d7b2bc-ac0b-4cd2-8eff-c99d5cf553a7 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:01.956773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f7d7b2bc-ac0b-4cd2-8eff-c99d5cf553a7 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:01.972221 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-37a22106-53e4-4150-a429-452d25c07964 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:01.972351 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f7d7b2bc-ac0b-4cd2-8eff-c99d5cf553a7 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:01.972351 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f7d7b2bc-ac0b-4cd2-8eff-c99d5cf553a7 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:01.972351 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f7d7b2bc-ac0b-4cd2-8eff-c99d5cf553a7 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:01.972351 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f7d7b2bc-ac0b-4cd2-8eff-c99d5cf553a7 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:01.972704 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f7d7b2bc-ac0b-4cd2-8eff-c99d5cf553a7 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:01.972704 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f7d7b2bc-ac0b-4cd2-8eff-c99d5cf553a7 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:01.977864 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-37a22106-53e4-4150-a429-452d25c07964 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1319 microversion: 2.1 time: 0.178025 Aug 26 15:53:01.992369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 165/331] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:01 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:02.036353 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f7d7b2bc-ac0b-4cd2-8eff-c99d5cf553a7 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:02.044960 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f7d7b2bc-ac0b-4cd2-8eff-c99d5cf553a7 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1143 microversion: 2.1 time: 0.092345 Aug 26 15:53:02.045661 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 167/332] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:01 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1143 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:02.972492 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e46d7ee5-69be-45b0-b98d-b6d50f82afae tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:02.973107 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e46d7ee5-69be-45b0-b98d-b6d50f82afae tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:02.975115 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:02.981099 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e46d7ee5-69be-45b0-b98d-b6d50f82afae tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:02.981590 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e46d7ee5-69be-45b0-b98d-b6d50f82afae tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:02.982019 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e46d7ee5-69be-45b0-b98d-b6d50f82afae tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:02.982837 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e46d7ee5-69be-45b0-b98d-b6d50f82afae tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:02.983234 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e46d7ee5-69be-45b0-b98d-b6d50f82afae tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:02.983656 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e46d7ee5-69be-45b0-b98d-b6d50f82afae tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:03.005058 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5c87a463-16b6-4702-9ec0-105c5e37f016 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:03.005839 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5c87a463-16b6-4702-9ec0-105c5e37f016 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:03.011993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c87a463-16b6-4702-9ec0-105c5e37f016 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:03.012619 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c87a463-16b6-4702-9ec0-105c5e37f016 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:03.013158 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c87a463-16b6-4702-9ec0-105c5e37f016 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:03.013973 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c87a463-16b6-4702-9ec0-105c5e37f016 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:03.014530 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c87a463-16b6-4702-9ec0-105c5e37f016 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:03.015053 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c87a463-16b6-4702-9ec0-105c5e37f016 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:03.134065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e46d7ee5-69be-45b0-b98d-b6d50f82afae tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:03.143344 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e46d7ee5-69be-45b0-b98d-b6d50f82afae tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1314 microversion: 2.1 time: 0.176134 Aug 26 15:53:03.159490 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 166/333] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:02 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:03.159490 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-929b994c-bcb1-44c2-a5c0-7399caf78f2f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:03.159490 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-929b994c-bcb1-44c2-a5c0-7399caf78f2f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:03.168435 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-929b994c-bcb1-44c2-a5c0-7399caf78f2f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:03.168435 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-929b994c-bcb1-44c2-a5c0-7399caf78f2f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:03.168435 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-929b994c-bcb1-44c2-a5c0-7399caf78f2f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:03.168435 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-929b994c-bcb1-44c2-a5c0-7399caf78f2f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:03.168888 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-929b994c-bcb1-44c2-a5c0-7399caf78f2f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:03.168888 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-929b994c-bcb1-44c2-a5c0-7399caf78f2f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:03.170162 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-5c87a463-16b6-4702-9ec0-105c5e37f016 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:03.178972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5c87a463-16b6-4702-9ec0-105c5e37f016 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1319 microversion: 2.1 time: 0.177753 Aug 26 15:53:03.182017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 168/334] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:03 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:03.250420 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-929b994c-bcb1-44c2-a5c0-7399caf78f2f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:03.258358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-929b994c-bcb1-44c2-a5c0-7399caf78f2f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1191 microversion: 2.1 time: 0.112107 Aug 26 15:53:03.258943 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 167/335] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:03 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1191 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:04.170193 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-59206703-24ec-4480-9170-63a265fcd141 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:04.170810 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-59206703-24ec-4480-9170-63a265fcd141 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:04.178727 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-59206703-24ec-4480-9170-63a265fcd141 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:04.179194 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-59206703-24ec-4480-9170-63a265fcd141 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:04.179629 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-59206703-24ec-4480-9170-63a265fcd141 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:04.180364 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-59206703-24ec-4480-9170-63a265fcd141 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:04.180820 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-59206703-24ec-4480-9170-63a265fcd141 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:04.181238 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-59206703-24ec-4480-9170-63a265fcd141 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:04.201519 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d9b5cfe1-4527-4e37-be5a-7930ffee0278 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:04.203174 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d9b5cfe1-4527-4e37-be5a-7930ffee0278 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:04.210425 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d9b5cfe1-4527-4e37-be5a-7930ffee0278 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:04.211278 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d9b5cfe1-4527-4e37-be5a-7930ffee0278 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:04.212035 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d9b5cfe1-4527-4e37-be5a-7930ffee0278 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:04.212978 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d9b5cfe1-4527-4e37-be5a-7930ffee0278 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:04.214150 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d9b5cfe1-4527-4e37-be5a-7930ffee0278 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:04.214150 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d9b5cfe1-4527-4e37-be5a-7930ffee0278 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:04.389216 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d9b5cfe1-4527-4e37-be5a-7930ffee0278 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:04.397819 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d9b5cfe1-4527-4e37-be5a-7930ffee0278 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1319 microversion: 2.1 time: 0.201688 Aug 26 15:53:04.398492 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 168/336] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:04 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:04.408297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6b8283fd-e8d4-4d4c-a506-dcfe322ebd9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:04.408297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6b8283fd-e8d4-4d4c-a506-dcfe322ebd9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:04.410547 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b8283fd-e8d4-4d4c-a506-dcfe322ebd9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:04.411296 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b8283fd-e8d4-4d4c-a506-dcfe322ebd9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:04.411980 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b8283fd-e8d4-4d4c-a506-dcfe322ebd9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:04.412760 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b8283fd-e8d4-4d4c-a506-dcfe322ebd9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:04.413425 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b8283fd-e8d4-4d4c-a506-dcfe322ebd9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:04.414108 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b8283fd-e8d4-4d4c-a506-dcfe322ebd9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:04.427079 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-59206703-24ec-4480-9170-63a265fcd141 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:04.436950 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-59206703-24ec-4480-9170-63a265fcd141 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1314 microversion: 2.1 time: 0.270701 Aug 26 15:53:04.437936 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 169/337] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:04 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:04.483834 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6b8283fd-e8d4-4d4c-a506-dcfe322ebd9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:04.496604 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6b8283fd-e8d4-4d4c-a506-dcfe322ebd9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1209 microversion: 2.1 time: 0.096610 Aug 26 15:53:04.497676 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 169/338] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:04 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:05.420143 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-47fbeb6d-e96d-4a11-bd06-5b0eae81f7fa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:05.420758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-47fbeb6d-e96d-4a11-bd06-5b0eae81f7fa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:05.427113 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-47fbeb6d-e96d-4a11-bd06-5b0eae81f7fa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:05.427604 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-47fbeb6d-e96d-4a11-bd06-5b0eae81f7fa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:05.428060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-47fbeb6d-e96d-4a11-bd06-5b0eae81f7fa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:05.428755 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-47fbeb6d-e96d-4a11-bd06-5b0eae81f7fa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:05.429382 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-47fbeb6d-e96d-4a11-bd06-5b0eae81f7fa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:05.429609 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-47fbeb6d-e96d-4a11-bd06-5b0eae81f7fa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:05.458738 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6c687d5d-3b2f-41ee-b681-658927ec5c4b tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:05.459980 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6c687d5d-3b2f-41ee-b681-658927ec5c4b tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:05.469452 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6c687d5d-3b2f-41ee-b681-658927ec5c4b tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:05.469452 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6c687d5d-3b2f-41ee-b681-658927ec5c4b tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:05.469452 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6c687d5d-3b2f-41ee-b681-658927ec5c4b tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:05.469452 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6c687d5d-3b2f-41ee-b681-658927ec5c4b tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:05.469990 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6c687d5d-3b2f-41ee-b681-658927ec5c4b tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:05.469990 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6c687d5d-3b2f-41ee-b681-658927ec5c4b tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:05.623164 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6c687d5d-3b2f-41ee-b681-658927ec5c4b tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:05.632528 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6c687d5d-3b2f-41ee-b681-658927ec5c4b tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1314 microversion: 2.1 time: 0.178047 Aug 26 15:53:05.633361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 170/339] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:05 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:05.637857 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-7520f704-9174-47e0-a096-a662282976bf req-00d887ca-f3d2-4cfb-9d5f-0bf39872badb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76fac001-d457-45b5-9479-98a195b7fae5", "name": "network-vif-plugged", "status": "completed", "tag": "029f9435-d874-4e82-8c5b-534e1fd3c3f4"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:05.647861 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-7520f704-9174-47e0-a096-a662282976bf req-00d887ca-f3d2-4cfb-9d5f-0bf39872badb service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:05.648500 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-7520f704-9174-47e0-a096-a662282976bf req-00d887ca-f3d2-4cfb-9d5f-0bf39872badb service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:05.649003 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-7520f704-9174-47e0-a096-a662282976bf req-00d887ca-f3d2-4cfb-9d5f-0bf39872badb service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:05.660703 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-7520f704-9174-47e0-a096-a662282976bf req-00d887ca-f3d2-4cfb-9d5f-0bf39872badb service nova] Creating event network-vif-plugged:029f9435-d874-4e82-8c5b-534e1fd3c3f4 for instance 76fac001-d457-45b5-9479-98a195b7fae5 on hv-cinder-83124 Aug 26 15:53:05.667526 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-7520f704-9174-47e0-a096-a662282976bf req-00d887ca-f3d2-4cfb-9d5f-0bf39872badb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032583 Aug 26 15:53:05.668073 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 171/340] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:53:05.681700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-2a6d8d75-bf1a-42ca-8ec6-c3c8481f2871 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:05.681700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-2a6d8d75-bf1a-42ca-8ec6-c3c8481f2871 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:05.681700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2a6d8d75-bf1a-42ca-8ec6-c3c8481f2871 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:05.681700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2a6d8d75-bf1a-42ca-8ec6-c3c8481f2871 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:05.682012 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2a6d8d75-bf1a-42ca-8ec6-c3c8481f2871 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:05.682495 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2a6d8d75-bf1a-42ca-8ec6-c3c8481f2871 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:05.682947 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2a6d8d75-bf1a-42ca-8ec6-c3c8481f2871 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:05.683369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2a6d8d75-bf1a-42ca-8ec6-c3c8481f2871 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:05.697669 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-47fbeb6d-e96d-4a11-bd06-5b0eae81f7fa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:05.709863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-47fbeb6d-e96d-4a11-bd06-5b0eae81f7fa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1319 microversion: 2.1 time: 0.293531 Aug 26 15:53:05.721142 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 170/341] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:05 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:05.851372 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2a6d8d75-bf1a-42ca-8ec6-c3c8481f2871 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:05.861478 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-2a6d8d75-bf1a-42ca-8ec6-c3c8481f2871 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1276 microversion: 2.1 time: 0.191636 Aug 26 15:53:05.862933 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 172/342] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:05 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1276 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:06.000448 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-99785e42-7b37-4997-a1b5-136248cb94d6 req-075e938d-493b-4875-8227-64450c46652a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "669aaa3a-3cdf-4764-aa7f-38e9cc9e9894", "tag": "ffc9d75b-ddcb-431d-a99f-fd94fe97633c"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:06.021328 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-99785e42-7b37-4997-a1b5-136248cb94d6 req-075e938d-493b-4875-8227-64450c46652a service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:06.036059 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-99785e42-7b37-4997-a1b5-136248cb94d6 req-075e938d-493b-4875-8227-64450c46652a service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:06.036059 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-99785e42-7b37-4997-a1b5-136248cb94d6 req-075e938d-493b-4875-8227-64450c46652a service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:06.036672 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-99785e42-7b37-4997-a1b5-136248cb94d6 req-075e938d-493b-4875-8227-64450c46652a service nova] Creating event network-changed:ffc9d75b-ddcb-431d-a99f-fd94fe97633c for instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 on hv-cinder-83124 Aug 26 15:53:06.042451 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-99785e42-7b37-4997-a1b5-136248cb94d6 req-075e938d-493b-4875-8227-64450c46652a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046231 Aug 26 15:53:06.043059 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 171/343] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:53:06.654983 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e6500df8-0516-404f-aee0-70abfdbfe532 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:06.655653 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e6500df8-0516-404f-aee0-70abfdbfe532 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:06.662779 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e6500df8-0516-404f-aee0-70abfdbfe532 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:06.663258 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e6500df8-0516-404f-aee0-70abfdbfe532 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:06.663721 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e6500df8-0516-404f-aee0-70abfdbfe532 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:06.664623 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e6500df8-0516-404f-aee0-70abfdbfe532 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:06.665111 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e6500df8-0516-404f-aee0-70abfdbfe532 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:06.665533 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e6500df8-0516-404f-aee0-70abfdbfe532 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:06.733104 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1b68eac8-950f-4b8a-adc3-e81d4f902b79 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:06.734565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-1b68eac8-950f-4b8a-adc3-e81d4f902b79 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:06.741561 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1b68eac8-950f-4b8a-adc3-e81d4f902b79 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:06.742049 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1b68eac8-950f-4b8a-adc3-e81d4f902b79 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:06.742538 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1b68eac8-950f-4b8a-adc3-e81d4f902b79 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:06.743243 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1b68eac8-950f-4b8a-adc3-e81d4f902b79 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:06.743690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1b68eac8-950f-4b8a-adc3-e81d4f902b79 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:06.744361 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1b68eac8-950f-4b8a-adc3-e81d4f902b79 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:06.807779 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e6500df8-0516-404f-aee0-70abfdbfe532 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:06.817121 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e6500df8-0516-404f-aee0-70abfdbfe532 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1314 microversion: 2.1 time: 0.166166 Aug 26 15:53:06.817710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 173/344] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:06 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:06.882756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0f289681-73fb-4919-880b-b3df4789a2d2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:06.883376 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0f289681-73fb-4919-880b-b3df4789a2d2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:06.889473 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0f289681-73fb-4919-880b-b3df4789a2d2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:06.890066 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0f289681-73fb-4919-880b-b3df4789a2d2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:06.890574 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0f289681-73fb-4919-880b-b3df4789a2d2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:06.891415 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0f289681-73fb-4919-880b-b3df4789a2d2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:06.891962 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0f289681-73fb-4919-880b-b3df4789a2d2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:06.893035 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0f289681-73fb-4919-880b-b3df4789a2d2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:06.895057 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1b68eac8-950f-4b8a-adc3-e81d4f902b79 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:06.902867 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-1b68eac8-950f-4b8a-adc3-e81d4f902b79 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1319 microversion: 2.1 time: 0.174062 Aug 26 15:53:06.903451 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 172/345] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:06 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:07.032852 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0f289681-73fb-4919-880b-b3df4789a2d2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:07.040701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0f289681-73fb-4919-880b-b3df4789a2d2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1264 microversion: 2.1 time: 0.162039 Aug 26 15:53:07.041275 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 174/346] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:06 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:07.682835 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-56035c0a-6607-4f1f-80ce-2405001dfef8 req-17a873fc-de4f-4409-9660-390cdd7af9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33", "name": "network-vif-plugged", "status": "completed", "tag": "52d33e41-9211-4ad4-ac40-766f6c12c9d8"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:07.693607 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-56035c0a-6607-4f1f-80ce-2405001dfef8 req-17a873fc-de4f-4409-9660-390cdd7af9ab service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:07.694069 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-56035c0a-6607-4f1f-80ce-2405001dfef8 req-17a873fc-de4f-4409-9660-390cdd7af9ab service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:07.694499 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-56035c0a-6607-4f1f-80ce-2405001dfef8 req-17a873fc-de4f-4409-9660-390cdd7af9ab service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:07.705924 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-56035c0a-6607-4f1f-80ce-2405001dfef8 req-17a873fc-de4f-4409-9660-390cdd7af9ab service nova] Creating event network-vif-plugged:52d33e41-9211-4ad4-ac40-766f6c12c9d8 for instance ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 on hv-cinder-83124 Aug 26 15:53:07.710794 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-56035c0a-6607-4f1f-80ce-2405001dfef8 req-17a873fc-de4f-4409-9660-390cdd7af9ab service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031627 Aug 26 15:53:07.711637 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 173/347] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:53:07.870210 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1b1f2129-5367-49ee-9149-fc5adacd66bf tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:07.870210 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1b1f2129-5367-49ee-9149-fc5adacd66bf tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:07.870210 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b1f2129-5367-49ee-9149-fc5adacd66bf tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:07.870210 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b1f2129-5367-49ee-9149-fc5adacd66bf tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:07.871014 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b1f2129-5367-49ee-9149-fc5adacd66bf tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:07.871014 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b1f2129-5367-49ee-9149-fc5adacd66bf tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:07.871014 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b1f2129-5367-49ee-9149-fc5adacd66bf tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:07.871014 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b1f2129-5367-49ee-9149-fc5adacd66bf tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:07.872467 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=100 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:07.926586 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4ccccd50-93af-4e31-9fe9-60363edf8ede tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:07.927373 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-4ccccd50-93af-4e31-9fe9-60363edf8ede tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:07.933677 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4ccccd50-93af-4e31-9fe9-60363edf8ede tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:07.934226 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4ccccd50-93af-4e31-9fe9-60363edf8ede tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:07.934722 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4ccccd50-93af-4e31-9fe9-60363edf8ede tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:07.935557 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4ccccd50-93af-4e31-9fe9-60363edf8ede tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:07.936105 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4ccccd50-93af-4e31-9fe9-60363edf8ede tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:07.936587 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4ccccd50-93af-4e31-9fe9-60363edf8ede tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:07.989523 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1b1f2129-5367-49ee-9149-fc5adacd66bf tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:07.997470 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1b1f2129-5367-49ee-9149-fc5adacd66bf tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1314 microversion: 2.1 time: 0.162529 Aug 26 15:53:07.998157 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 175/348] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:07 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:08.062489 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-09423a0f-e049-44d0-a283-a7d60e3ce1a8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:08.063103 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-09423a0f-e049-44d0-a283-a7d60e3ce1a8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:08.069584 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09423a0f-e049-44d0-a283-a7d60e3ce1a8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:08.070063 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09423a0f-e049-44d0-a283-a7d60e3ce1a8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:08.070204 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4ccccd50-93af-4e31-9fe9-60363edf8ede tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:08.070497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09423a0f-e049-44d0-a283-a7d60e3ce1a8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:08.071193 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09423a0f-e049-44d0-a283-a7d60e3ce1a8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:08.071671 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09423a0f-e049-44d0-a283-a7d60e3ce1a8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:08.072122 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09423a0f-e049-44d0-a283-a7d60e3ce1a8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:08.078762 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4ccccd50-93af-4e31-9fe9-60363edf8ede tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1319 microversion: 2.1 time: 0.159559 Aug 26 15:53:08.081374 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 174/349] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:07 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:08.209693 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-09423a0f-e049-44d0-a283-a7d60e3ce1a8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:08.217606 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-09423a0f-e049-44d0-a283-a7d60e3ce1a8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1264 microversion: 2.1 time: 0.158996 Aug 26 15:53:08.218179 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 176/350] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:08 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:09.018376 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7cc7c032-8f5f-480d-810c-071c607add89 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:09.025031 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7cc7c032-8f5f-480d-810c-071c607add89 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:09.029184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7cc7c032-8f5f-480d-810c-071c607add89 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:09.029819 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7cc7c032-8f5f-480d-810c-071c607add89 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:09.030379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7cc7c032-8f5f-480d-810c-071c607add89 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:09.031155 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7cc7c032-8f5f-480d-810c-071c607add89 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:09.031714 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7cc7c032-8f5f-480d-810c-071c607add89 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:09.032198 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7cc7c032-8f5f-480d-810c-071c607add89 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:09.100737 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9697456c-564a-4df7-8b44-5cf882fd4842 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:09.101331 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9697456c-564a-4df7-8b44-5cf882fd4842 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:09.107832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9697456c-564a-4df7-8b44-5cf882fd4842 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:09.108343 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9697456c-564a-4df7-8b44-5cf882fd4842 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:09.109087 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9697456c-564a-4df7-8b44-5cf882fd4842 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:09.109807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9697456c-564a-4df7-8b44-5cf882fd4842 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:09.110256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9697456c-564a-4df7-8b44-5cf882fd4842 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:09.110835 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9697456c-564a-4df7-8b44-5cf882fd4842 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:09.230788 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7cc7c032-8f5f-480d-810c-071c607add89 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:09.240163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7cc7c032-8f5f-480d-810c-071c607add89 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1464 microversion: 2.1 time: 0.225882 Aug 26 15:53:09.240726 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 175/351] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:09 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1464 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:09.245392 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-28b16bb8-eaa7-44fb-9b3a-2750474622ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:09.245990 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-28b16bb8-eaa7-44fb-9b3a-2750474622ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:09.251959 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28b16bb8-eaa7-44fb-9b3a-2750474622ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:09.252867 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28b16bb8-eaa7-44fb-9b3a-2750474622ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:09.253476 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28b16bb8-eaa7-44fb-9b3a-2750474622ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:09.254472 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28b16bb8-eaa7-44fb-9b3a-2750474622ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:09.255137 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28b16bb8-eaa7-44fb-9b3a-2750474622ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:09.256063 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28b16bb8-eaa7-44fb-9b3a-2750474622ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:09.275411 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9697456c-564a-4df7-8b44-5cf882fd4842 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:09.286408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9697456c-564a-4df7-8b44-5cf882fd4842 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1319 microversion: 2.1 time: 0.189528 Aug 26 15:53:09.287137 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 177/352] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:09 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:09.297246 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b4be9bc8-16ef-4899-ad83-e4ca2d201ff5 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:09.297957 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b4be9bc8-16ef-4899-ad83-e4ca2d201ff5 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:09.304371 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b4be9bc8-16ef-4899-ad83-e4ca2d201ff5 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:09.304858 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b4be9bc8-16ef-4899-ad83-e4ca2d201ff5 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:09.305297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b4be9bc8-16ef-4899-ad83-e4ca2d201ff5 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:09.306004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b4be9bc8-16ef-4899-ad83-e4ca2d201ff5 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:09.306457 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b4be9bc8-16ef-4899-ad83-e4ca2d201ff5 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:09.306886 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b4be9bc8-16ef-4899-ad83-e4ca2d201ff5 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:09.334489 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b4be9bc8-16ef-4899-ad83-e4ca2d201ff5 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Going to try to terminate instance {{(pid=127697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:53:09.401748 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-28b16bb8-eaa7-44fb-9b3a-2750474622ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:09.405290 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=100 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:09.410438 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-28b16bb8-eaa7-44fb-9b3a-2750474622ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1264 microversion: 2.1 time: 0.168602 Aug 26 15:53:09.413812 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 176/353] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:09 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:09.651341 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b4be9bc8-16ef-4899-ad83-e4ca2d201ff5 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "DELETE /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 204 len: 0 microversion: 2.1 time: 0.362737 Aug 26 15:53:09.651949 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 178/354] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:53:09 2022] DELETE /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:53:09.660845 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0d57d533-0e7b-4b78-aa95-68607e214040 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:09.663456 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0d57d533-0e7b-4b78-aa95-68607e214040 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:09.667985 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d57d533-0e7b-4b78-aa95-68607e214040 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:09.668466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d57d533-0e7b-4b78-aa95-68607e214040 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:09.668896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d57d533-0e7b-4b78-aa95-68607e214040 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:09.669576 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d57d533-0e7b-4b78-aa95-68607e214040 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:09.670026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d57d533-0e7b-4b78-aa95-68607e214040 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:09.670444 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d57d533-0e7b-4b78-aa95-68607e214040 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:09.810249 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0d57d533-0e7b-4b78-aa95-68607e214040 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:09.818806 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0d57d533-0e7b-4b78-aa95-68607e214040 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1470 microversion: 2.1 time: 0.162575 Aug 26 15:53:09.820460 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 177/355] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:09 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:10.307424 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5e83e36b-3fac-41c3-a7fa-587d51d4681c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:10.319383 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5e83e36b-3fac-41c3-a7fa-587d51d4681c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:10.319383 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e83e36b-3fac-41c3-a7fa-587d51d4681c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:10.319383 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e83e36b-3fac-41c3-a7fa-587d51d4681c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:10.319383 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e83e36b-3fac-41c3-a7fa-587d51d4681c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:10.319763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e83e36b-3fac-41c3-a7fa-587d51d4681c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:10.319763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e83e36b-3fac-41c3-a7fa-587d51d4681c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:10.319763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e83e36b-3fac-41c3-a7fa-587d51d4681c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:10.430558 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-cb8ee26f-76e4-442c-be67-8e20c4507722 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:10.431318 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-cb8ee26f-76e4-442c-be67-8e20c4507722 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:10.434140 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=4 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:10.436366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=16 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:10.438192 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb8ee26f-76e4-442c-be67-8e20c4507722 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:10.438672 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb8ee26f-76e4-442c-be67-8e20c4507722 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:10.439103 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb8ee26f-76e4-442c-be67-8e20c4507722 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:10.439787 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb8ee26f-76e4-442c-be67-8e20c4507722 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:10.440286 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb8ee26f-76e4-442c-be67-8e20c4507722 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:10.440961 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb8ee26f-76e4-442c-be67-8e20c4507722 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:10.450939 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5e83e36b-3fac-41c3-a7fa-587d51d4681c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:10.459030 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5e83e36b-3fac-41c3-a7fa-587d51d4681c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1319 microversion: 2.1 time: 0.155756 Aug 26 15:53:10.459749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 179/356] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:10 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:10.591005 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-cb8ee26f-76e4-442c-be67-8e20c4507722 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:10.599319 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-cb8ee26f-76e4-442c-be67-8e20c4507722 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1264 microversion: 2.1 time: 0.172579 Aug 26 15:53:10.600287 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 178/357] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:10 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:10.840628 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-72d35745-6671-4ed8-a9e6-7eb75bb8a99a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:10.841241 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-72d35745-6671-4ed8-a9e6-7eb75bb8a99a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:10.843299 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=12 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:10.848767 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-72d35745-6671-4ed8-a9e6-7eb75bb8a99a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:10.849284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-72d35745-6671-4ed8-a9e6-7eb75bb8a99a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:10.849727 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-72d35745-6671-4ed8-a9e6-7eb75bb8a99a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:10.850434 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-72d35745-6671-4ed8-a9e6-7eb75bb8a99a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:10.850889 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-72d35745-6671-4ed8-a9e6-7eb75bb8a99a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:10.851310 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-72d35745-6671-4ed8-a9e6-7eb75bb8a99a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:10.987396 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-72d35745-6671-4ed8-a9e6-7eb75bb8a99a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:10.995711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-72d35745-6671-4ed8-a9e6-7eb75bb8a99a tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1470 microversion: 2.1 time: 0.159081 Aug 26 15:53:10.998234 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 180/358] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:10 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:11.480889 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-40896c4c-1cf4-4c85-890f-45319221f659 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:11.481654 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-40896c4c-1cf4-4c85-890f-45319221f659 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:11.487860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-40896c4c-1cf4-4c85-890f-45319221f659 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:11.488462 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-40896c4c-1cf4-4c85-890f-45319221f659 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:11.488895 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-40896c4c-1cf4-4c85-890f-45319221f659 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:11.489584 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-40896c4c-1cf4-4c85-890f-45319221f659 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:11.490027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-40896c4c-1cf4-4c85-890f-45319221f659 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:11.490445 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-40896c4c-1cf4-4c85-890f-45319221f659 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:11.620046 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-934447b5-c9a8-4826-bd42-c9a3b4cf582f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:11.620821 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-934447b5-c9a8-4826-bd42-c9a3b4cf582f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:11.628162 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-934447b5-c9a8-4826-bd42-c9a3b4cf582f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:11.628670 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-934447b5-c9a8-4826-bd42-c9a3b4cf582f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:11.629155 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-934447b5-c9a8-4826-bd42-c9a3b4cf582f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:11.629838 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-934447b5-c9a8-4826-bd42-c9a3b4cf582f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:11.630529 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-934447b5-c9a8-4826-bd42-c9a3b4cf582f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:11.630953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-934447b5-c9a8-4826-bd42-c9a3b4cf582f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:11.657026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-40896c4c-1cf4-4c85-890f-45319221f659 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:11.665038 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-40896c4c-1cf4-4c85-890f-45319221f659 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1319 microversion: 2.1 time: 0.187867 Aug 26 15:53:11.670071 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 179/359] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:11 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:11.771123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-934447b5-c9a8-4826-bd42-c9a3b4cf582f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:11.779385 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-934447b5-c9a8-4826-bd42-c9a3b4cf582f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1264 microversion: 2.1 time: 0.163217 Aug 26 15:53:11.780221 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 181/360] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:11 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:12.019943 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-94bb0158-27f3-4310-92ad-e12fafec4543 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:12.019943 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-94bb0158-27f3-4310-92ad-e12fafec4543 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:12.031175 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94bb0158-27f3-4310-92ad-e12fafec4543 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:12.032020 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94bb0158-27f3-4310-92ad-e12fafec4543 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:12.032461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94bb0158-27f3-4310-92ad-e12fafec4543 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:12.037765 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94bb0158-27f3-4310-92ad-e12fafec4543 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:12.038357 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94bb0158-27f3-4310-92ad-e12fafec4543 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:12.038794 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94bb0158-27f3-4310-92ad-e12fafec4543 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:12.172624 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-94bb0158-27f3-4310-92ad-e12fafec4543 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:12.181041 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-94bb0158-27f3-4310-92ad-e12fafec4543 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1470 microversion: 2.1 time: 0.166932 Aug 26 15:53:12.181608 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 180/361] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:12 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:12.693781 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-41756c9f-95ed-4420-8f0f-ea04c6ff2d4b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:12.694544 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-41756c9f-95ed-4420-8f0f-ea04c6ff2d4b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:12.701647 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-41756c9f-95ed-4420-8f0f-ea04c6ff2d4b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:12.702117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-41756c9f-95ed-4420-8f0f-ea04c6ff2d4b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:12.702550 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-41756c9f-95ed-4420-8f0f-ea04c6ff2d4b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:12.703259 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-41756c9f-95ed-4420-8f0f-ea04c6ff2d4b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:12.703699 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-41756c9f-95ed-4420-8f0f-ea04c6ff2d4b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:12.704177 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-41756c9f-95ed-4420-8f0f-ea04c6ff2d4b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:12.799459 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1a14a099-05b1-440d-a05c-8bc2649e0132 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:12.800085 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-1a14a099-05b1-440d-a05c-8bc2649e0132 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:12.806055 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1a14a099-05b1-440d-a05c-8bc2649e0132 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:12.806527 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1a14a099-05b1-440d-a05c-8bc2649e0132 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:12.807139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1a14a099-05b1-440d-a05c-8bc2649e0132 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:12.807822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1a14a099-05b1-440d-a05c-8bc2649e0132 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:12.808299 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1a14a099-05b1-440d-a05c-8bc2649e0132 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:12.808714 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1a14a099-05b1-440d-a05c-8bc2649e0132 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:12.837824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-41756c9f-95ed-4420-8f0f-ea04c6ff2d4b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:12.845828 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-41756c9f-95ed-4420-8f0f-ea04c6ff2d4b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1508 microversion: 2.1 time: 0.156917 Aug 26 15:53:12.846531 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 182/362] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:12 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:12.945872 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1a14a099-05b1-440d-a05c-8bc2649e0132 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:12.954082 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-1a14a099-05b1-440d-a05c-8bc2649e0132 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1264 microversion: 2.1 time: 0.158406 Aug 26 15:53:12.954693 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 181/363] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:12 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:13.203560 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5cd8bd9a-c40b-4a03-94f5-662c2ad4d00e tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:13.204206 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5cd8bd9a-c40b-4a03-94f5-662c2ad4d00e tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:13.210216 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5cd8bd9a-c40b-4a03-94f5-662c2ad4d00e tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:13.210702 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5cd8bd9a-c40b-4a03-94f5-662c2ad4d00e tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:13.211140 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5cd8bd9a-c40b-4a03-94f5-662c2ad4d00e tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:13.211903 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5cd8bd9a-c40b-4a03-94f5-662c2ad4d00e tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:13.212388 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5cd8bd9a-c40b-4a03-94f5-662c2ad4d00e tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:13.212985 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5cd8bd9a-c40b-4a03-94f5-662c2ad4d00e tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:13.352033 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5cd8bd9a-c40b-4a03-94f5-662c2ad4d00e tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:13.360279 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5cd8bd9a-c40b-4a03-94f5-662c2ad4d00e tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1470 microversion: 2.1 time: 0.161177 Aug 26 15:53:13.361436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 183/364] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:13 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:13.975039 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-23a3a5e0-0b7c-4826-81c5-6298a4a29a76 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:13.975732 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-23a3a5e0-0b7c-4826-81c5-6298a4a29a76 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:13.981902 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-23a3a5e0-0b7c-4826-81c5-6298a4a29a76 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:13.982383 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-23a3a5e0-0b7c-4826-81c5-6298a4a29a76 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:13.982979 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-23a3a5e0-0b7c-4826-81c5-6298a4a29a76 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:13.983674 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-23a3a5e0-0b7c-4826-81c5-6298a4a29a76 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:13.984140 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-23a3a5e0-0b7c-4826-81c5-6298a4a29a76 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:13.984558 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-23a3a5e0-0b7c-4826-81c5-6298a4a29a76 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:14.184340 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-23a3a5e0-0b7c-4826-81c5-6298a4a29a76 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:14.196293 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-23a3a5e0-0b7c-4826-81c5-6298a4a29a76 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1264 microversion: 2.1 time: 0.225103 Aug 26 15:53:14.197469 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 182/365] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:13 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1264 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:14.239555 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-46ba0392-1bb5-4454-9b09-d5e8e9290b02 req-25e4caed-4e9e-48db-ba83-d86dc0141a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76fac001-d457-45b5-9479-98a195b7fae5", "name": "network-vif-deleted", "tag": "029f9435-d874-4e82-8c5b-534e1fd3c3f4"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:14.254768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-46ba0392-1bb5-4454-9b09-d5e8e9290b02 req-25e4caed-4e9e-48db-ba83-d86dc0141a52 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:14.255034 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-46ba0392-1bb5-4454-9b09-d5e8e9290b02 req-25e4caed-4e9e-48db-ba83-d86dc0141a52 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:14.255464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-46ba0392-1bb5-4454-9b09-d5e8e9290b02 req-25e4caed-4e9e-48db-ba83-d86dc0141a52 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:14.272565 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-46ba0392-1bb5-4454-9b09-d5e8e9290b02 req-25e4caed-4e9e-48db-ba83-d86dc0141a52 service nova] Creating event network-vif-deleted:029f9435-d874-4e82-8c5b-534e1fd3c3f4 for instance 76fac001-d457-45b5-9479-98a195b7fae5 on hv-cinder-83124 Aug 26 15:53:14.278096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-46ba0392-1bb5-4454-9b09-d5e8e9290b02 req-25e4caed-4e9e-48db-ba83-d86dc0141a52 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042217 Aug 26 15:53:14.279256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 184/366] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:53:14.383309 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f84f4086-45e1-4947-a21f-40e0b53288f1 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:14.383943 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f84f4086-45e1-4947-a21f-40e0b53288f1 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:14.390359 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f84f4086-45e1-4947-a21f-40e0b53288f1 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:14.390824 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f84f4086-45e1-4947-a21f-40e0b53288f1 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:14.391458 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f84f4086-45e1-4947-a21f-40e0b53288f1 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:14.392089 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f84f4086-45e1-4947-a21f-40e0b53288f1 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:14.392602 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f84f4086-45e1-4947-a21f-40e0b53288f1 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:14.400238 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f84f4086-45e1-4947-a21f-40e0b53288f1 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:14.460592 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f84f4086-45e1-4947-a21f-40e0b53288f1 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:14.469040 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f84f4086-45e1-4947-a21f-40e0b53288f1 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1428 microversion: 2.1 time: 0.089644 Aug 26 15:53:14.474309 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 183/367] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:14 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1428 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:15.218750 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-dfea388d-9d92-4277-9654-bcf35cc8e7f4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:15.219458 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-dfea388d-9d92-4277-9654-bcf35cc8e7f4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:15.220853 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-fea65ff6-3c83-4621-8025-d4842661f649 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:15.221370 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-fea65ff6-3c83-4621-8025-d4842661f649 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:15.228029 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fea65ff6-3c83-4621-8025-d4842661f649 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:15.228513 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dfea388d-9d92-4277-9654-bcf35cc8e7f4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:15.228630 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fea65ff6-3c83-4621-8025-d4842661f649 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:15.228949 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fea65ff6-3c83-4621-8025-d4842661f649 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:15.229076 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dfea388d-9d92-4277-9654-bcf35cc8e7f4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:15.229423 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dfea388d-9d92-4277-9654-bcf35cc8e7f4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:15.229667 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fea65ff6-3c83-4621-8025-d4842661f649 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:15.230115 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fea65ff6-3c83-4621-8025-d4842661f649 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:15.230262 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dfea388d-9d92-4277-9654-bcf35cc8e7f4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:15.230840 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fea65ff6-3c83-4621-8025-d4842661f649 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:15.230975 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dfea388d-9d92-4277-9654-bcf35cc8e7f4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:15.231342 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dfea388d-9d92-4277-9654-bcf35cc8e7f4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:15.290570 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-fea65ff6-3c83-4621-8025-d4842661f649 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/ips" status: 200 len: 149 microversion: 2.1 time: 0.074059 Aug 26 15:53:15.291192 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 184/368] 10.222.0.98 () {58 vars in 1248 bytes} [Fri Aug 26 15:53:15 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/ips => generated 149 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:53:15.399232 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-dfea388d-9d92-4277-9654-bcf35cc8e7f4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:15.406928 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-dfea388d-9d92-4277-9654-bcf35cc8e7f4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1264 microversion: 2.1 time: 0.192885 Aug 26 15:53:15.407493 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 185/369] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:15 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:15.490831 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a861701a-d5f8-4bed-9df0-e24572c6daa9 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:15.495643 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a861701a-d5f8-4bed-9df0-e24572c6daa9 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:15.497521 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a861701a-d5f8-4bed-9df0-e24572c6daa9 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:15.498002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a861701a-d5f8-4bed-9df0-e24572c6daa9 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:15.498429 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a861701a-d5f8-4bed-9df0-e24572c6daa9 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:15.499109 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a861701a-d5f8-4bed-9df0-e24572c6daa9 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:15.499551 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a861701a-d5f8-4bed-9df0-e24572c6daa9 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:15.499997 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a861701a-d5f8-4bed-9df0-e24572c6daa9 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:15.564505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-a861701a-d5f8-4bed-9df0-e24572c6daa9 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:15.571089 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-a861701a-d5f8-4bed-9df0-e24572c6daa9 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1299 microversion: 2.1 time: 0.084023 Aug 26 15:53:15.571665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 185/370] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:15 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:16.428329 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-cbff85e5-6ee7-4af4-bb1d-638975016bf4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:16.429102 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-cbff85e5-6ee7-4af4-bb1d-638975016bf4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:16.436386 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cbff85e5-6ee7-4af4-bb1d-638975016bf4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:16.436878 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cbff85e5-6ee7-4af4-bb1d-638975016bf4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:16.437314 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cbff85e5-6ee7-4af4-bb1d-638975016bf4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:16.438023 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cbff85e5-6ee7-4af4-bb1d-638975016bf4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:16.438472 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cbff85e5-6ee7-4af4-bb1d-638975016bf4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:16.438891 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cbff85e5-6ee7-4af4-bb1d-638975016bf4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:16.576872 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cbff85e5-6ee7-4af4-bb1d-638975016bf4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:16.586028 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-cbff85e5-6ee7-4af4-bb1d-638975016bf4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1264 microversion: 2.1 time: 0.161881 Aug 26 15:53:16.586606 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 186/371] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:16 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:16.592462 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4b1b78ec-48d9-4992-b77b-2914c2a64a57 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:16.593181 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-4b1b78ec-48d9-4992-b77b-2914c2a64a57 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:16.599145 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b1b78ec-48d9-4992-b77b-2914c2a64a57 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:16.599618 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b1b78ec-48d9-4992-b77b-2914c2a64a57 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:16.606917 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b1b78ec-48d9-4992-b77b-2914c2a64a57 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:16.606917 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b1b78ec-48d9-4992-b77b-2914c2a64a57 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:16.606917 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b1b78ec-48d9-4992-b77b-2914c2a64a57 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:16.606917 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b1b78ec-48d9-4992-b77b-2914c2a64a57 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:16.632398 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b1b78ec-48d9-4992-b77b-2914c2a64a57 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:16.632871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b1b78ec-48d9-4992-b77b-2914c2a64a57 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:16.633303 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b1b78ec-48d9-4992-b77b-2914c2a64a57 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:16.633738 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-4b1b78ec-48d9-4992-b77b-2914c2a64a57 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lazy-loading 'fault' on Instance uuid 76fac001-d457-45b5-9479-98a195b7fae5 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:53:16.677279 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4b1b78ec-48d9-4992-b77b-2914c2a64a57 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c179cd4dc6943419d793a1eb05dc0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9df73d19f4955b822a056d9545a92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:16.685223 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4b1b78ec-48d9-4992-b77b-2914c2a64a57 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 200 len: 1304 microversion: 2.1 time: 0.096932 Aug 26 15:53:16.685790 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 186/372] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:16 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:17.608659 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-2900e1f7-771a-4917-ba6f-75bb630e82a5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:17.609652 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-2900e1f7-771a-4917-ba6f-75bb630e82a5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:17.616440 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2900e1f7-771a-4917-ba6f-75bb630e82a5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:17.616928 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2900e1f7-771a-4917-ba6f-75bb630e82a5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:17.617367 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2900e1f7-771a-4917-ba6f-75bb630e82a5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:17.618093 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2900e1f7-771a-4917-ba6f-75bb630e82a5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:17.618547 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2900e1f7-771a-4917-ba6f-75bb630e82a5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:17.618971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2900e1f7-771a-4917-ba6f-75bb630e82a5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:17.709250 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-6aed2f85-879d-4242-aa87-ab3f76185cc8 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:17.710593 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-6aed2f85-879d-4242-aa87-ab3f76185cc8 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] [instance: 76fac001-d457-45b5-9479-98a195b7fae5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:17.717194 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6aed2f85-879d-4242-aa87-ab3f76185cc8 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:17.717994 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6aed2f85-879d-4242-aa87-ab3f76185cc8 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:17.718436 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6aed2f85-879d-4242-aa87-ab3f76185cc8 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:17.719145 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6aed2f85-879d-4242-aa87-ab3f76185cc8 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:17.719601 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6aed2f85-879d-4242-aa87-ab3f76185cc8 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:17.720058 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6aed2f85-879d-4242-aa87-ab3f76185cc8 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:17.736024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-6aed2f85-879d-4242-aa87-ab3f76185cc8 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] HTTP exception thrown: Instance 76fac001-d457-45b5-9479-98a195b7fae5 could not be found. Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-6aed2f85-879d-4242-aa87-ab3f76185cc8 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Request method failure captured: Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 HTTP/1.1 Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOxINrkd-wPoJdj-Lum6-gpKGdrSuM37EcKYhqLIWcbd5YM4PlHsywJKCgli-bCMXXKlWRX26hSypF5O-bdrfLZIz4w3KVSBHimM7GG2qxiI5OqXsjP5cp14VElaqRZTQBNWuC4hQwOmc1-VndQMu5rVEiOGVodHN4O9t7SEqlDuQ5c Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: 09d9df73d19f4955b822a056d9545a92 Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-VolumesNegativeTest-1607232418 Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:53:17.738061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:53:17.739466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/09d9df73d19f4955b822a056d9545a92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_09d9df73d19f4955b822a056d9545a92", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/09d9df73d19f4955b822a056d9545a92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/09d9df73d19f4955b822a056d9545a92"}]}] Aug 26 15:53:17.739466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-VolumesNegativeTest-1607232418 Aug 26 15:53:17.739466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: 09d9df73d19f4955b822a056d9545a92 Aug 26 15:53:17.739466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-VolumesNegativeTest-1607232418 Aug 26 15:53:17.739466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-VolumesNegativeTest-1607232418-project Aug 26 15:53:17.739466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:53:17.739466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:53:17.739466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 1c179cd4dc6943419d793a1eb05dc0b5 Aug 26 15:53:17.739466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-VolumesNegativeTest-1607232418-project Aug 26 15:53:17.739466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:53:17.739466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance 76fac001-d457-45b5-9479-98a195b7fae5 could not be found. Aug 26 15:53:17.739466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '76fac001-d457-45b5-9479-98a195b7fae5'} Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76fac001-d457-45b5-9479-98a195b7fae5 could not be found. Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:53:17.740285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76fac001-d457-45b5-9479-98a195b7fae5 could not be found. Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76fac001-d457-45b5-9479-98a195b7fae5 could not be found. Aug 26 15:53:17.741491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:53:17.742582 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-6aed2f85-879d-4242-aa87-ab3f76185cc8 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] Returning 404 to user: Instance 76fac001-d457-45b5-9479-98a195b7fae5 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:53:17.742582 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-6aed2f85-879d-4242-aa87-ab3f76185cc8 tempest-VolumesNegativeTest-1607232418 tempest-VolumesNegativeTest-1607232418-project] 10.222.0.98 "GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5" status: 404 len: 111 microversion: 2.1 time: 0.036604 Aug 26 15:53:17.742582 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 187/373] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:17 2022] GET /compute/v2.1/servers/76fac001-d457-45b5-9479-98a195b7fae5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:53:17.761512 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2900e1f7-771a-4917-ba6f-75bb630e82a5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:17.782339 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-2900e1f7-771a-4917-ba6f-75bb630e82a5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1264 microversion: 2.1 time: 0.176881 Aug 26 15:53:17.784407 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 187/374] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:17 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:18.357069 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3f67c1d9-8ef9-4fdb-991c-8e774c863cd6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0f3c062-35ae-426e-bb26-695869ec48b5"}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:18.362934 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3f67c1d9-8ef9-4fdb-991c-8e774c863cd6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:18.364891 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:18.369658 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3f67c1d9-8ef9-4fdb-991c-8e774c863cd6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:18.370136 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3f67c1d9-8ef9-4fdb-991c-8e774c863cd6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:18.370595 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3f67c1d9-8ef9-4fdb-991c-8e774c863cd6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:18.371458 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3f67c1d9-8ef9-4fdb-991c-8e774c863cd6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:18.371932 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3f67c1d9-8ef9-4fdb-991c-8e774c863cd6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:18.372383 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3f67c1d9-8ef9-4fdb-991c-8e774c863cd6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:18.555150 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-10164ddd-e245-4005-82ce-b07c30139eef req-0b243d1c-7512-4525-96a9-ff894b356fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "669aaa3a-3cdf-4764-aa7f-38e9cc9e9894", "name": "network-vif-plugged", "status": "completed", "tag": "ffc9d75b-ddcb-431d-a99f-fd94fe97633c"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:18.565025 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-10164ddd-e245-4005-82ce-b07c30139eef req-0b243d1c-7512-4525-96a9-ff894b356fe8 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:18.565490 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-10164ddd-e245-4005-82ce-b07c30139eef req-0b243d1c-7512-4525-96a9-ff894b356fe8 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:18.566170 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-10164ddd-e245-4005-82ce-b07c30139eef req-0b243d1c-7512-4525-96a9-ff894b356fe8 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:18.576860 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-10164ddd-e245-4005-82ce-b07c30139eef req-0b243d1c-7512-4525-96a9-ff894b356fe8 service nova] Creating event network-vif-plugged:ffc9d75b-ddcb-431d-a99f-fd94fe97633c for instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 on hv-cinder-83124 Aug 26 15:53:18.581767 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-10164ddd-e245-4005-82ce-b07c30139eef req-0b243d1c-7512-4525-96a9-ff894b356fe8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030488 Aug 26 15:53:18.582360 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 188/375] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:53:18.808412 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-964df1ee-04d5-4351-b9a6-c8e68e22b11a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:18.809154 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-964df1ee-04d5-4351-b9a6-c8e68e22b11a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:18.817768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-964df1ee-04d5-4351-b9a6-c8e68e22b11a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:18.818720 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-964df1ee-04d5-4351-b9a6-c8e68e22b11a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:18.819184 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-964df1ee-04d5-4351-b9a6-c8e68e22b11a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:18.819980 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-964df1ee-04d5-4351-b9a6-c8e68e22b11a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:18.820646 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-964df1ee-04d5-4351-b9a6-c8e68e22b11a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:18.821071 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-964df1ee-04d5-4351-b9a6-c8e68e22b11a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:19.027568 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-964df1ee-04d5-4351-b9a6-c8e68e22b11a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:19.036052 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-964df1ee-04d5-4351-b9a6-c8e68e22b11a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1264 microversion: 2.1 time: 0.233249 Aug 26 15:53:19.036625 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 189/376] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:18 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1264 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:19.500390 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3f67c1d9-8ef9-4fdb-991c-8e774c863cd6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "POST /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.147182 Aug 26 15:53:19.502491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 188/377] 10.222.0.98 () {60 vars in 1323 bytes} [Fri Aug 26 15:53:18 2022] POST /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments => generated 194 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:53:20.059195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f9db6e05-56b7-4d9f-a0ac-230f8a057027 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:20.060169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f9db6e05-56b7-4d9f-a0ac-230f8a057027 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:20.068373 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f9db6e05-56b7-4d9f-a0ac-230f8a057027 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:20.068965 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f9db6e05-56b7-4d9f-a0ac-230f8a057027 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:20.069341 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f9db6e05-56b7-4d9f-a0ac-230f8a057027 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:20.070104 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f9db6e05-56b7-4d9f-a0ac-230f8a057027 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:20.070562 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f9db6e05-56b7-4d9f-a0ac-230f8a057027 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:20.070997 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f9db6e05-56b7-4d9f-a0ac-230f8a057027 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:20.234975 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f9db6e05-56b7-4d9f-a0ac-230f8a057027 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:20.245475 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f9db6e05-56b7-4d9f-a0ac-230f8a057027 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1264 microversion: 2.1 time: 0.192050 Aug 26 15:53:20.246322 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 190/378] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:20 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:21.268635 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c9dc7a93-b9f4-4629-b49a-0be8ef81c972 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:21.272559 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c9dc7a93-b9f4-4629-b49a-0be8ef81c972 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:21.284113 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c9dc7a93-b9f4-4629-b49a-0be8ef81c972 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:21.284113 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c9dc7a93-b9f4-4629-b49a-0be8ef81c972 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:21.284113 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c9dc7a93-b9f4-4629-b49a-0be8ef81c972 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:21.284113 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c9dc7a93-b9f4-4629-b49a-0be8ef81c972 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:21.284561 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c9dc7a93-b9f4-4629-b49a-0be8ef81c972 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:21.284561 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c9dc7a93-b9f4-4629-b49a-0be8ef81c972 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:21.459033 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c9dc7a93-b9f4-4629-b49a-0be8ef81c972 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:21.464200 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c9dc7a93-b9f4-4629-b49a-0be8ef81c972 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1450 microversion: 2.1 time: 0.201207 Aug 26 15:53:21.464925 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 189/379] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:21 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1450 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:21.486603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d97387b6-6d94-490e-a8e8-7c68d6c90e7f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:21.488079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d97387b6-6d94-490e-a8e8-7c68d6c90e7f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:21.495851 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:21.497524 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d97387b6-6d94-490e-a8e8-7c68d6c90e7f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:21.498180 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d97387b6-6d94-490e-a8e8-7c68d6c90e7f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:21.498636 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d97387b6-6d94-490e-a8e8-7c68d6c90e7f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:21.499331 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d97387b6-6d94-490e-a8e8-7c68d6c90e7f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:21.499776 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d97387b6-6d94-490e-a8e8-7c68d6c90e7f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:21.500281 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d97387b6-6d94-490e-a8e8-7c68d6c90e7f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:21.647331 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d97387b6-6d94-490e-a8e8-7c68d6c90e7f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:21.650800 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:21.655450 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d97387b6-6d94-490e-a8e8-7c68d6c90e7f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1450 microversion: 2.1 time: 0.174096 Aug 26 15:53:21.656070 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 191/380] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:21 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:24.007448 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-95646f00-bde7-48a2-a5b4-4a6f27591beb req-ed1ea8e5-ceb1-4e10-beb9-cec4b586fc9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "669aaa3a-3cdf-4764-aa7f-38e9cc9e9894", "tag": "ffc9d75b-ddcb-431d-a99f-fd94fe97633c"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:24.018777 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-95646f00-bde7-48a2-a5b4-4a6f27591beb req-ed1ea8e5-ceb1-4e10-beb9-cec4b586fc9c service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:24.019488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-95646f00-bde7-48a2-a5b4-4a6f27591beb req-ed1ea8e5-ceb1-4e10-beb9-cec4b586fc9c service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:24.020155 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-95646f00-bde7-48a2-a5b4-4a6f27591beb req-ed1ea8e5-ceb1-4e10-beb9-cec4b586fc9c service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:24.031619 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-95646f00-bde7-48a2-a5b4-4a6f27591beb req-ed1ea8e5-ceb1-4e10-beb9-cec4b586fc9c service nova] Creating event network-changed:ffc9d75b-ddcb-431d-a99f-fd94fe97633c for instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 on hv-cinder-83124 Aug 26 15:53:24.037162 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-95646f00-bde7-48a2-a5b4-4a6f27591beb req-ed1ea8e5-ceb1-4e10-beb9-cec4b586fc9c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033360 Aug 26 15:53:24.038122 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 190/381] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:53:29.307893 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-4df360ec-cdd1-44aa-9c8b-c59697faa63c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Action: 'create', calling method: .version_select at 0x7fbd1e66d430>, body: {"keypair": {"name": "tempest-keypair-1712514585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtQRC0rgltVV2qzan2eEI0G/oCA8u5HY0gcleZUUWYoAn6ZccE2odMrhfcf7Yq8+ER+Y1bp/VvNa/OPojhpdx0YqjxYfWyvRl/qoGm7WuSIK1AuBfO+tcVeHGIB3arAVg=="}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:29.325944 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-4df360ec-cdd1-44aa-9c8b-c59697faa63c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for project f40d6476c750438c9c09107c7757fa95. Resources: {'key_pairs'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:53:29.329808 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-4df360ec-cdd1-44aa-9c8b-c59697faa63c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for user 9348310fd06b473786d1c6be4f20c481 and project f40d6476c750438c9c09107c7757fa95. Resources: {'key_pairs'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:53:29.422119 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-4df360ec-cdd1-44aa-9c8b-c59697faa63c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118333 Aug 26 15:53:29.422710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 192/382] 10.222.0.98 () {60 vars in 1159 bytes} [Fri Aug 26 15:53:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:53:31.944668 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e2504eea-2807-4901-be7e-9e3e5becb58e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:31.946021 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e2504eea-2807-4901-be7e-9e3e5becb58e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:31.953971 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e2504eea-2807-4901-be7e-9e3e5becb58e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:31.955644 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e2504eea-2807-4901-be7e-9e3e5becb58e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:31.956496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e2504eea-2807-4901-be7e-9e3e5becb58e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:31.957384 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e2504eea-2807-4901-be7e-9e3e5becb58e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:31.957919 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e2504eea-2807-4901-be7e-9e3e5becb58e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:31.958564 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e2504eea-2807-4901-be7e-9e3e5becb58e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:32.110044 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-e2504eea-2807-4901-be7e-9e3e5becb58e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lazy-loading 'services' on Instance uuid 6bdeefc3-4622-43da-a414-d7813721bc01 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:53:32.373900 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d6557bde-8cc2-4662-86a2-d409834e8db3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1145727f-9298-496b-955c-b995f6c62dfe"}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:32.375644 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d6557bde-8cc2-4662-86a2-d409834e8db3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:32.384373 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6557bde-8cc2-4662-86a2-d409834e8db3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:32.384957 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6557bde-8cc2-4662-86a2-d409834e8db3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:32.385555 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6557bde-8cc2-4662-86a2-d409834e8db3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:32.386281 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6557bde-8cc2-4662-86a2-d409834e8db3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:32.387301 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6557bde-8cc2-4662-86a2-d409834e8db3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:32.387301 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6557bde-8cc2-4662-86a2-d409834e8db3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:32.403955 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e2504eea-2807-4901-be7e-9e3e5becb58e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/os-volume_attachments/dfa52430-c05f-41fb-81e9-8cccf1cf7058" status: 202 len: 0 microversion: 2.1 time: 0.464925 Aug 26 15:53:32.405038 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 191/383] 10.222.0.98 () {58 vars in 1416 bytes} [Fri Aug 26 15:53:31 2022] DELETE /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/os-volume_attachments/dfa52430-c05f-41fb-81e9-8cccf1cf7058 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:53:32.779936 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1252530441", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a335b766-ffd8-4d30-a4fc-6d81d957bfbd"}], "security_groups": [{"name": "tempest-securitygroup--1288450490"}], "key_name": "tempest-keypair-1712514585", "user_data": "}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:32.954488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.network.neutron [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] validate_networks() for [('a335b766-ffd8-4d30-a4fc-6d81d957bfbd', None, None, None, None, None)] {{(pid=127698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:53:33.978623 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Flavor limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:53:33.978623 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Image limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:53:33.979398 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Flavor pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:53:33.979480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Image pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:53:33.979905 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:53:33.990802 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:33.991228 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:33.991849 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:33.993143 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:33.993800 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:33.994634 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:34.019051 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for project f40d6476c750438c9c09107c7757fa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:53:34.025345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for user 9348310fd06b473786d1c6be4f20c481 and project f40d6476c750438c9c09107c7757fa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:53:34.043941 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Going to run 1 instances... {{(pid=127698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:53:34.046455 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:53:34.187606 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d6557bde-8cc2-4662-86a2-d409834e8db3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "POST /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.820204 Aug 26 15:53:34.203202 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 193/384] 10.222.0.98 () {60 vars in 1323 bytes} [Fri Aug 26 15:53:32 2022] POST /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 194 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:53:34.249668 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-94ce9a18-9d3c-423c-a29c-8dc8caa04dc1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.473919 Aug 26 15:53:34.258826 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 192/385] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:53:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:53:34.264746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7c854a1a-6dd2-4f45-a337-d3f1946484f4 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:34.265954 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7c854a1a-6dd2-4f45-a337-d3f1946484f4 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:34.390491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7c854a1a-6dd2-4f45-a337-d3f1946484f4 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:34.408918 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7c854a1a-6dd2-4f45-a337-d3f1946484f4 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1242 microversion: 2.1 time: 0.149267 Aug 26 15:53:34.417620 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 194/386] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:34 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1242 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:34.700824 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-34c38e1e-c1f9-487d-bc9b-09b518defa25 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:34.708813 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-34c38e1e-c1f9-487d-bc9b-09b518defa25 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:34.709458 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-34c38e1e-c1f9-487d-bc9b-09b518defa25 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:34.710131 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-34c38e1e-c1f9-487d-bc9b-09b518defa25 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:34.785086 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:34.795154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-34c38e1e-c1f9-487d-bc9b-09b518defa25 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Going to try to stop instance {{(pid=127698) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 15:53:35.106865 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-34c38e1e-c1f9-487d-bc9b-09b518defa25 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "POST /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/action" status: 202 len: 0 microversion: 2.1 time: 0.411876 Aug 26 15:53:35.107541 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 193/387] 10.222.0.98 () {60 vars in 1278 bytes} [Fri Aug 26 15:53:34 2022] POST /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:53:35.117461 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c56264c3-4208-465f-a816-ec707c13b6db tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:35.117461 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c56264c3-4208-465f-a816-ec707c13b6db tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:35.137534 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c56264c3-4208-465f-a816-ec707c13b6db tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:35.138058 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c56264c3-4208-465f-a816-ec707c13b6db tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:35.138499 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c56264c3-4208-465f-a816-ec707c13b6db tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:35.139209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c56264c3-4208-465f-a816-ec707c13b6db tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:35.139665 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c56264c3-4208-465f-a816-ec707c13b6db tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:35.140122 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c56264c3-4208-465f-a816-ec707c13b6db tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:35.319981 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c56264c3-4208-465f-a816-ec707c13b6db tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:35.342475 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c56264c3-4208-465f-a816-ec707c13b6db tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1676 microversion: 2.1 time: 0.229699 Aug 26 15:53:35.344191 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 195/388] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:35 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1676 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:35.431760 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-52540922-3037-4305-ab5f-482c15543663 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:35.432534 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-52540922-3037-4305-ab5f-482c15543663 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:35.442472 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-52540922-3037-4305-ab5f-482c15543663 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:35.443247 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-52540922-3037-4305-ab5f-482c15543663 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:35.443720 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-52540922-3037-4305-ab5f-482c15543663 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:35.444466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-52540922-3037-4305-ab5f-482c15543663 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:35.444981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-52540922-3037-4305-ab5f-482c15543663 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:35.446220 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-52540922-3037-4305-ab5f-482c15543663 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:35.538936 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-52540922-3037-4305-ab5f-482c15543663 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:35.549695 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-52540922-3037-4305-ab5f-482c15543663 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1246 microversion: 2.1 time: 0.122334 Aug 26 15:53:35.552293 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 194/389] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:35 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1246 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:36.367766 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9fc3d4fa-40fc-416e-bcb0-d3ec84a81b4b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:36.375173 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9fc3d4fa-40fc-416e-bcb0-d3ec84a81b4b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:36.390632 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9fc3d4fa-40fc-416e-bcb0-d3ec84a81b4b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:36.391402 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9fc3d4fa-40fc-416e-bcb0-d3ec84a81b4b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:36.394355 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9fc3d4fa-40fc-416e-bcb0-d3ec84a81b4b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:36.395379 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9fc3d4fa-40fc-416e-bcb0-d3ec84a81b4b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:36.396086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9fc3d4fa-40fc-416e-bcb0-d3ec84a81b4b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:36.398656 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9fc3d4fa-40fc-416e-bcb0-d3ec84a81b4b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:36.460329 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0605fa98-5f5c-4a3f-90ac-8dec94345a8f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e87f654-4aa0-447d-9ca9-337e3921ae87", "device": "/dev/sdb"}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:36.465282 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0605fa98-5f5c-4a3f-90ac-8dec94345a8f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:36.474603 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0605fa98-5f5c-4a3f-90ac-8dec94345a8f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:36.475200 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0605fa98-5f5c-4a3f-90ac-8dec94345a8f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:36.475724 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0605fa98-5f5c-4a3f-90ac-8dec94345a8f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:36.476525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0605fa98-5f5c-4a3f-90ac-8dec94345a8f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:36.477052 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0605fa98-5f5c-4a3f-90ac-8dec94345a8f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:36.477704 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0605fa98-5f5c-4a3f-90ac-8dec94345a8f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:36.585631 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9fc3d4fa-40fc-416e-bcb0-d3ec84a81b4b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:36.595279 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9fc3d4fa-40fc-416e-bcb0-d3ec84a81b4b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1676 microversion: 2.1 time: 0.232570 Aug 26 15:53:36.604022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 196/390] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:36 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1676 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:36.610901 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1c2ce18d-1c4b-4caa-befb-1df246867762 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:36.611634 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1c2ce18d-1c4b-4caa-befb-1df246867762 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:36.620415 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1c2ce18d-1c4b-4caa-befb-1df246867762 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:36.621239 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1c2ce18d-1c4b-4caa-befb-1df246867762 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:36.621685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1c2ce18d-1c4b-4caa-befb-1df246867762 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:36.622984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1c2ce18d-1c4b-4caa-befb-1df246867762 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:36.623656 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1c2ce18d-1c4b-4caa-befb-1df246867762 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:36.624179 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1c2ce18d-1c4b-4caa-befb-1df246867762 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:36.702366 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1c2ce18d-1c4b-4caa-befb-1df246867762 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:36.710832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1c2ce18d-1c4b-4caa-befb-1df246867762 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1294 microversion: 2.1 time: 0.105143 Aug 26 15:53:36.711415 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 197/391] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:36 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:37.622032 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-311a3868-1ac7-4b0a-a7b3-8cbf6facf428 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:37.622658 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-311a3868-1ac7-4b0a-a7b3-8cbf6facf428 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:37.630417 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-311a3868-1ac7-4b0a-a7b3-8cbf6facf428 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:37.631150 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-311a3868-1ac7-4b0a-a7b3-8cbf6facf428 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:37.631811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-311a3868-1ac7-4b0a-a7b3-8cbf6facf428 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:37.632708 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-311a3868-1ac7-4b0a-a7b3-8cbf6facf428 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:37.633892 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-311a3868-1ac7-4b0a-a7b3-8cbf6facf428 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:37.634537 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-311a3868-1ac7-4b0a-a7b3-8cbf6facf428 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:37.868263 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-311a3868-1ac7-4b0a-a7b3-8cbf6facf428 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:37.876083 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-311a3868-1ac7-4b0a-a7b3-8cbf6facf428 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1676 microversion: 2.1 time: 0.257922 Aug 26 15:53:37.876658 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 198/392] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:37 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1676 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:37.882706 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e563e68d-7c68-49a7-954c-93e3706ad774 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:37.883321 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e563e68d-7c68-49a7-954c-93e3706ad774 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:37.889492 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e563e68d-7c68-49a7-954c-93e3706ad774 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:37.889968 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e563e68d-7c68-49a7-954c-93e3706ad774 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:37.890533 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e563e68d-7c68-49a7-954c-93e3706ad774 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:37.891227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e563e68d-7c68-49a7-954c-93e3706ad774 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:37.891670 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e563e68d-7c68-49a7-954c-93e3706ad774 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:37.892110 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e563e68d-7c68-49a7-954c-93e3706ad774 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:37.995959 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e563e68d-7c68-49a7-954c-93e3706ad774 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:38.008975 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e563e68d-7c68-49a7-954c-93e3706ad774 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1294 microversion: 2.1 time: 0.130406 Aug 26 15:53:38.010341 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 199/393] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:37 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1294 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:38.019950 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1eb3b893-df8f-4f50-8146-ce816973c638 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:38.022923 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1eb3b893-df8f-4f50-8146-ce816973c638 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:38.030030 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1eb3b893-df8f-4f50-8146-ce816973c638 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:38.030604 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1eb3b893-df8f-4f50-8146-ce816973c638 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:38.031048 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1eb3b893-df8f-4f50-8146-ce816973c638 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:38.031816 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1eb3b893-df8f-4f50-8146-ce816973c638 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:38.032300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1eb3b893-df8f-4f50-8146-ce816973c638 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:38.032724 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1eb3b893-df8f-4f50-8146-ce816973c638 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:38.051947 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0605fa98-5f5c-4a3f-90ac-8dec94345a8f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "POST /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.615891 Aug 26 15:53:38.059814 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 195/394] 10.222.0.98 () {60 vars in 1323 bytes} [Fri Aug 26 15:53:36 2022] POST /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33/os-volume_attachments => generated 194 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:53:38.075181 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-1eb3b893-df8f-4f50-8146-ce816973c638 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lazy-loading 'flavor' on Instance uuid 08d976c8-85c3-48de-80ba-93fdff79445a {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:53:38.499609 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1eb3b893-df8f-4f50-8146-ce816973c638 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "POST /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/action" status: 200 len: 32 microversion: 2.1 time: 0.487737 Aug 26 15:53:38.500776 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 200/395] 10.222.0.98 () {60 vars in 1278 bytes} [Fri Aug 26 15:53:38 2022] POST /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/action => generated 32 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 15:53:38.511581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0257d95e-20db-4471-bf03-bcd086f37da5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:38.512748 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0257d95e-20db-4471-bf03-bcd086f37da5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:38.520810 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0257d95e-20db-4471-bf03-bcd086f37da5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:38.521593 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0257d95e-20db-4471-bf03-bcd086f37da5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:38.522198 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0257d95e-20db-4471-bf03-bcd086f37da5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:38.523067 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0257d95e-20db-4471-bf03-bcd086f37da5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:38.523664 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0257d95e-20db-4471-bf03-bcd086f37da5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:38.524363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0257d95e-20db-4471-bf03-bcd086f37da5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:38.859137 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0257d95e-20db-4471-bf03-bcd086f37da5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:38.875685 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0257d95e-20db-4471-bf03-bcd086f37da5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.368689 Aug 26 15:53:38.876841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 196/396] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:38 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:38.900348 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-463831fe-6a6f-45d2-ad85-e2bfab9a195e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:38.901072 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-463831fe-6a6f-45d2-ad85-e2bfab9a195e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:38.911523 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-463831fe-6a6f-45d2-ad85-e2bfab9a195e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:38.912837 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-463831fe-6a6f-45d2-ad85-e2bfab9a195e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:38.913942 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-463831fe-6a6f-45d2-ad85-e2bfab9a195e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:38.914705 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-463831fe-6a6f-45d2-ad85-e2bfab9a195e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:38.915236 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-463831fe-6a6f-45d2-ad85-e2bfab9a195e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:38.915671 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-463831fe-6a6f-45d2-ad85-e2bfab9a195e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:39.034838 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d044c328-0127-4484-8b40-211e06ef8b39 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:39.034838 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d044c328-0127-4484-8b40-211e06ef8b39 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:39.047389 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d044c328-0127-4484-8b40-211e06ef8b39 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:39.049243 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d044c328-0127-4484-8b40-211e06ef8b39 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:39.049934 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d044c328-0127-4484-8b40-211e06ef8b39 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:39.050923 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d044c328-0127-4484-8b40-211e06ef8b39 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:39.051642 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d044c328-0127-4484-8b40-211e06ef8b39 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:39.053825 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d044c328-0127-4484-8b40-211e06ef8b39 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:39.147320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d044c328-0127-4484-8b40-211e06ef8b39 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:39.176523 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d044c328-0127-4484-8b40-211e06ef8b39 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1312 microversion: 2.1 time: 0.149648 Aug 26 15:53:39.192812 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 197/397] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:39 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:39.256843 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-463831fe-6a6f-45d2-ad85-e2bfab9a195e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:39.286557 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-463831fe-6a6f-45d2-ad85-e2bfab9a195e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1676 microversion: 2.1 time: 0.370738 Aug 26 15:53:39.286557 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 201/398] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:38 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1676 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:39.902953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1c5cf1d0-e81a-4cab-9459-3a6ee1eb7616 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:39.903501 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-1c5cf1d0-e81a-4cab-9459-3a6ee1eb7616 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:39.918441 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1c5cf1d0-e81a-4cab-9459-3a6ee1eb7616 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:39.918441 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1c5cf1d0-e81a-4cab-9459-3a6ee1eb7616 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:39.918441 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1c5cf1d0-e81a-4cab-9459-3a6ee1eb7616 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:39.918441 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1c5cf1d0-e81a-4cab-9459-3a6ee1eb7616 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:39.918767 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1c5cf1d0-e81a-4cab-9459-3a6ee1eb7616 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:39.918767 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1c5cf1d0-e81a-4cab-9459-3a6ee1eb7616 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:40.133493 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1c5cf1d0-e81a-4cab-9459-3a6ee1eb7616 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:40.142758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-1c5cf1d0-e81a-4cab-9459-3a6ee1eb7616 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.243915 Aug 26 15:53:40.143419 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 198/399] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:39 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:40.199671 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0201fb02-d008-41f1-9d4b-754b90176d45 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:40.202930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0201fb02-d008-41f1-9d4b-754b90176d45 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:40.208062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0201fb02-d008-41f1-9d4b-754b90176d45 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:40.208538 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0201fb02-d008-41f1-9d4b-754b90176d45 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:40.209263 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0201fb02-d008-41f1-9d4b-754b90176d45 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:40.209959 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0201fb02-d008-41f1-9d4b-754b90176d45 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:40.210547 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0201fb02-d008-41f1-9d4b-754b90176d45 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:40.211143 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0201fb02-d008-41f1-9d4b-754b90176d45 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:40.293474 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-043836bc-4763-4585-9796-0aa33029d68d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:40.294141 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-043836bc-4763-4585-9796-0aa33029d68d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:40.307311 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-043836bc-4763-4585-9796-0aa33029d68d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:40.307311 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-043836bc-4763-4585-9796-0aa33029d68d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:40.307311 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-043836bc-4763-4585-9796-0aa33029d68d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:40.307311 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-043836bc-4763-4585-9796-0aa33029d68d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:40.308195 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-043836bc-4763-4585-9796-0aa33029d68d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:40.308195 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-043836bc-4763-4585-9796-0aa33029d68d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:40.453801 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0201fb02-d008-41f1-9d4b-754b90176d45 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:40.463479 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0201fb02-d008-41f1-9d4b-754b90176d45 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1368 microversion: 2.1 time: 0.267616 Aug 26 15:53:40.465353 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 202/400] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:40 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:40.936983 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-043836bc-4763-4585-9796-0aa33029d68d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:40.946415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-043836bc-4763-4585-9796-0aa33029d68d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1676 microversion: 2.1 time: 0.657502 Aug 26 15:53:40.947425 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 199/401] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:40 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1676 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:41.164930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b4227b1e-65d5-4e75-b5ef-dd3b0eadf9b2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:41.165481 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b4227b1e-65d5-4e75-b5ef-dd3b0eadf9b2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:41.179357 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b4227b1e-65d5-4e75-b5ef-dd3b0eadf9b2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:41.180236 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b4227b1e-65d5-4e75-b5ef-dd3b0eadf9b2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:41.181023 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b4227b1e-65d5-4e75-b5ef-dd3b0eadf9b2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:41.182223 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b4227b1e-65d5-4e75-b5ef-dd3b0eadf9b2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:41.182989 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b4227b1e-65d5-4e75-b5ef-dd3b0eadf9b2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:41.184036 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b4227b1e-65d5-4e75-b5ef-dd3b0eadf9b2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:41.331012 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b4227b1e-65d5-4e75-b5ef-dd3b0eadf9b2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:41.340498 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b4227b1e-65d5-4e75-b5ef-dd3b0eadf9b2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.179638 Aug 26 15:53:41.349814 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 203/402] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:41 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:41.486702 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b90d63ce-3912-4254-819f-7dd881adcb68 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:41.487312 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b90d63ce-3912-4254-819f-7dd881adcb68 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:41.493424 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b90d63ce-3912-4254-819f-7dd881adcb68 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:41.493909 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b90d63ce-3912-4254-819f-7dd881adcb68 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:41.494460 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b90d63ce-3912-4254-819f-7dd881adcb68 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:41.495026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b90d63ce-3912-4254-819f-7dd881adcb68 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:41.495474 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b90d63ce-3912-4254-819f-7dd881adcb68 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:41.495973 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b90d63ce-3912-4254-819f-7dd881adcb68 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:41.842515 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-b90d63ce-3912-4254-819f-7dd881adcb68 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:41.851988 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-b90d63ce-3912-4254-819f-7dd881adcb68 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1368 microversion: 2.1 time: 0.369086 Aug 26 15:53:41.853056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 200/403] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:41 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1368 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:41.968050 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-3d4e5845-b470-406a-be0f-4563a5eadf92 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:41.968663 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-3d4e5845-b470-406a-be0f-4563a5eadf92 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:41.975010 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3d4e5845-b470-406a-be0f-4563a5eadf92 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:41.975490 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3d4e5845-b470-406a-be0f-4563a5eadf92 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:41.975947 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3d4e5845-b470-406a-be0f-4563a5eadf92 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:41.976639 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3d4e5845-b470-406a-be0f-4563a5eadf92 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:41.977089 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3d4e5845-b470-406a-be0f-4563a5eadf92 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:41.977510 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3d4e5845-b470-406a-be0f-4563a5eadf92 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:42.072314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-e419d1f2-bd29-4189-839a-2bfc74e518eb req-409486d8-7741-4e56-9905-0026aeb89c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af463f4-5ec2-4134-81cf-bd9adfc4853f", "tag": "539f60bc-cce0-48d0-b6bc-2e857f41b14d"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:42.084220 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-e419d1f2-bd29-4189-839a-2bfc74e518eb req-409486d8-7741-4e56-9905-0026aeb89c1d service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:42.084994 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-e419d1f2-bd29-4189-839a-2bfc74e518eb req-409486d8-7741-4e56-9905-0026aeb89c1d service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:42.085428 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-e419d1f2-bd29-4189-839a-2bfc74e518eb req-409486d8-7741-4e56-9905-0026aeb89c1d service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:42.097397 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-e419d1f2-bd29-4189-839a-2bfc74e518eb req-409486d8-7741-4e56-9905-0026aeb89c1d service nova] Creating event network-changed:539f60bc-cce0-48d0-b6bc-2e857f41b14d for instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f on hv-cinder-83124 Aug 26 15:53:42.103800 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-e419d1f2-bd29-4189-839a-2bfc74e518eb req-409486d8-7741-4e56-9905-0026aeb89c1d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034964 Aug 26 15:53:42.105281 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 201/404] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:53:42.117807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-3d4e5845-b470-406a-be0f-4563a5eadf92 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:42.127505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-3d4e5845-b470-406a-be0f-4563a5eadf92 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1676 microversion: 2.1 time: 0.163204 Aug 26 15:53:42.128120 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 204/405] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:41 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:42.363252 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-338ccab8-58ef-443f-a2a2-e4302b87eb49 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:42.364068 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-338ccab8-58ef-443f-a2a2-e4302b87eb49 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:42.371470 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-338ccab8-58ef-443f-a2a2-e4302b87eb49 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:42.372313 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-338ccab8-58ef-443f-a2a2-e4302b87eb49 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:42.372950 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-338ccab8-58ef-443f-a2a2-e4302b87eb49 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:42.373703 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-338ccab8-58ef-443f-a2a2-e4302b87eb49 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:42.374317 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-338ccab8-58ef-443f-a2a2-e4302b87eb49 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:42.374993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-338ccab8-58ef-443f-a2a2-e4302b87eb49 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:42.564431 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-338ccab8-58ef-443f-a2a2-e4302b87eb49 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:42.574529 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-338ccab8-58ef-443f-a2a2-e4302b87eb49 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.216017 Aug 26 15:53:42.578943 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 202/406] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:42 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:42.873354 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-400b84cd-d542-495b-ae1f-cb7e1781dff4 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:42.874074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-400b84cd-d542-495b-ae1f-cb7e1781dff4 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:42.881920 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-400b84cd-d542-495b-ae1f-cb7e1781dff4 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:42.882799 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-400b84cd-d542-495b-ae1f-cb7e1781dff4 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:42.883446 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-400b84cd-d542-495b-ae1f-cb7e1781dff4 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:42.884571 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-400b84cd-d542-495b-ae1f-cb7e1781dff4 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:42.885249 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-400b84cd-d542-495b-ae1f-cb7e1781dff4 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:42.885887 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-400b84cd-d542-495b-ae1f-cb7e1781dff4 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:43.150959 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ba59e62f-f390-4827-8fa0-312627d6d33b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:43.151679 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ba59e62f-f390-4827-8fa0-312627d6d33b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:43.159072 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ba59e62f-f390-4827-8fa0-312627d6d33b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:43.159654 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ba59e62f-f390-4827-8fa0-312627d6d33b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:43.160227 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ba59e62f-f390-4827-8fa0-312627d6d33b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:43.160999 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ba59e62f-f390-4827-8fa0-312627d6d33b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:43.161553 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ba59e62f-f390-4827-8fa0-312627d6d33b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:43.162049 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ba59e62f-f390-4827-8fa0-312627d6d33b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:43.184958 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-400b84cd-d542-495b-ae1f-cb7e1781dff4 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:43.196733 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-400b84cd-d542-495b-ae1f-cb7e1781dff4 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1368 microversion: 2.1 time: 0.327188 Aug 26 15:53:43.210051 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 205/407] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:42 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1368 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:43.304381 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ba59e62f-f390-4827-8fa0-312627d6d33b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:43.313060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ba59e62f-f390-4827-8fa0-312627d6d33b tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1676 microversion: 2.1 time: 0.167861 Aug 26 15:53:43.313635 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 203/408] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:43 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:43.608075 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0b8ce76e-e29f-421a-b633-afe1751852c6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:43.608708 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0b8ce76e-e29f-421a-b633-afe1751852c6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:43.627613 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0b8ce76e-e29f-421a-b633-afe1751852c6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:43.630583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0b8ce76e-e29f-421a-b633-afe1751852c6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:43.631073 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0b8ce76e-e29f-421a-b633-afe1751852c6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:43.632430 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0b8ce76e-e29f-421a-b633-afe1751852c6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:43.632901 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0b8ce76e-e29f-421a-b633-afe1751852c6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:43.635367 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0b8ce76e-e29f-421a-b633-afe1751852c6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:43.802868 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0b8ce76e-e29f-421a-b633-afe1751852c6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:43.814496 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0b8ce76e-e29f-421a-b633-afe1751852c6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.214452 Aug 26 15:53:43.814496 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 206/409] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:43 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:44.216927 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a672b37e-f46f-4c47-81dd-22c9db20f539 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:44.217522 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a672b37e-f46f-4c47-81dd-22c9db20f539 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:44.219737 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:44.220423 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=6 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:44.226459 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a672b37e-f46f-4c47-81dd-22c9db20f539 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:44.226942 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a672b37e-f46f-4c47-81dd-22c9db20f539 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:44.227375 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a672b37e-f46f-4c47-81dd-22c9db20f539 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:44.228122 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a672b37e-f46f-4c47-81dd-22c9db20f539 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:44.228638 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a672b37e-f46f-4c47-81dd-22c9db20f539 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:44.228957 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a672b37e-f46f-4c47-81dd-22c9db20f539 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:44.336821 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b267ba36-ef8e-43a4-9846-570c35cd6508 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:44.338031 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b267ba36-ef8e-43a4-9846-570c35cd6508 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:44.358083 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b267ba36-ef8e-43a4-9846-570c35cd6508 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:44.364408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b267ba36-ef8e-43a4-9846-570c35cd6508 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:44.371090 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b267ba36-ef8e-43a4-9846-570c35cd6508 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:44.371090 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b267ba36-ef8e-43a4-9846-570c35cd6508 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:44.371090 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b267ba36-ef8e-43a4-9846-570c35cd6508 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:44.371090 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b267ba36-ef8e-43a4-9846-570c35cd6508 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:44.371425 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:44.375796 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-a672b37e-f46f-4c47-81dd-22c9db20f539 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:44.387203 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-a672b37e-f46f-4c47-81dd-22c9db20f539 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1368 microversion: 2.1 time: 0.174103 Aug 26 15:53:44.388304 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 204/410] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:44 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:44.394569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=6 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:44.564066 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b267ba36-ef8e-43a4-9846-570c35cd6508 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:44.572654 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b267ba36-ef8e-43a4-9846-570c35cd6508 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1676 microversion: 2.1 time: 0.240100 Aug 26 15:53:44.573225 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 207/411] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:44 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:44.834074 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-89b6d0e7-6cf0-4cd7-aa21-5da4e1d96a06 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:44.835023 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-89b6d0e7-6cf0-4cd7-aa21-5da4e1d96a06 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:44.840976 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89b6d0e7-6cf0-4cd7-aa21-5da4e1d96a06 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:44.841456 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89b6d0e7-6cf0-4cd7-aa21-5da4e1d96a06 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:44.841905 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89b6d0e7-6cf0-4cd7-aa21-5da4e1d96a06 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:44.842576 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89b6d0e7-6cf0-4cd7-aa21-5da4e1d96a06 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:44.843023 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89b6d0e7-6cf0-4cd7-aa21-5da4e1d96a06 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:44.843442 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89b6d0e7-6cf0-4cd7-aa21-5da4e1d96a06 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:44.974368 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-89b6d0e7-6cf0-4cd7-aa21-5da4e1d96a06 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:44.982518 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-89b6d0e7-6cf0-4cd7-aa21-5da4e1d96a06 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.152592 Aug 26 15:53:44.988969 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 205/412] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:44 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:45.410833 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b231866b-0601-42b2-9c54-432201aa52a8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:45.411435 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b231866b-0601-42b2-9c54-432201aa52a8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:45.420032 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b231866b-0601-42b2-9c54-432201aa52a8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:45.420275 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b231866b-0601-42b2-9c54-432201aa52a8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:45.420916 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b231866b-0601-42b2-9c54-432201aa52a8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:45.421817 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b231866b-0601-42b2-9c54-432201aa52a8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:45.422451 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b231866b-0601-42b2-9c54-432201aa52a8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:45.423053 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b231866b-0601-42b2-9c54-432201aa52a8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:45.597650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0f7b6410-9dea-4082-b125-9b7009d4befb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:45.599168 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0f7b6410-9dea-4082-b125-9b7009d4befb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:45.607613 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f7b6410-9dea-4082-b125-9b7009d4befb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:45.608255 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f7b6410-9dea-4082-b125-9b7009d4befb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:45.608558 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f7b6410-9dea-4082-b125-9b7009d4befb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:45.609253 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f7b6410-9dea-4082-b125-9b7009d4befb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:45.609777 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f7b6410-9dea-4082-b125-9b7009d4befb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:45.610103 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f7b6410-9dea-4082-b125-9b7009d4befb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:45.613343 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b231866b-0601-42b2-9c54-432201aa52a8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:45.621357 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b231866b-0601-42b2-9c54-432201aa52a8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1368 microversion: 2.1 time: 0.214845 Aug 26 15:53:45.641620 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 208/413] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:45 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:45.836459 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0f7b6410-9dea-4082-b125-9b7009d4befb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:45.847687 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0f7b6410-9dea-4082-b125-9b7009d4befb tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1676 microversion: 2.1 time: 0.257390 Aug 26 15:53:45.865973 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 206/414] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:45 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1676 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:46.004266 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-3da6a633-5d7e-4ad2-88b9-9efb68b22ef1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:46.005145 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-3da6a633-5d7e-4ad2-88b9-9efb68b22ef1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:46.016770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3da6a633-5d7e-4ad2-88b9-9efb68b22ef1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:46.018262 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3da6a633-5d7e-4ad2-88b9-9efb68b22ef1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:46.019914 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3da6a633-5d7e-4ad2-88b9-9efb68b22ef1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:46.021400 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3da6a633-5d7e-4ad2-88b9-9efb68b22ef1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:46.021884 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3da6a633-5d7e-4ad2-88b9-9efb68b22ef1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:46.024495 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3da6a633-5d7e-4ad2-88b9-9efb68b22ef1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:46.221787 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-3da6a633-5d7e-4ad2-88b9-9efb68b22ef1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:46.232572 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-3da6a633-5d7e-4ad2-88b9-9efb68b22ef1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.232479 Aug 26 15:53:46.234035 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 209/415] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:45 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:46.660336 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-36d05367-2fd6-4711-8a94-c2f7ced8b577 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:46.660987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-36d05367-2fd6-4711-8a94-c2f7ced8b577 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:46.673315 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-36d05367-2fd6-4711-8a94-c2f7ced8b577 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:46.674184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-36d05367-2fd6-4711-8a94-c2f7ced8b577 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:46.675631 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-36d05367-2fd6-4711-8a94-c2f7ced8b577 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:46.678541 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-36d05367-2fd6-4711-8a94-c2f7ced8b577 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:46.679047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-36d05367-2fd6-4711-8a94-c2f7ced8b577 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:46.679487 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-36d05367-2fd6-4711-8a94-c2f7ced8b577 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:46.866273 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-36d05367-2fd6-4711-8a94-c2f7ced8b577 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:46.875487 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-581dd59c-3874-457c-a48c-b0e8833a72ce tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:46.876198 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-581dd59c-3874-457c-a48c-b0e8833a72ce tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:46.880307 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-36d05367-2fd6-4711-8a94-c2f7ced8b577 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1368 microversion: 2.1 time: 0.241699 Aug 26 15:53:46.882030 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 207/416] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:46 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:46.885117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-581dd59c-3874-457c-a48c-b0e8833a72ce tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:46.885859 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-581dd59c-3874-457c-a48c-b0e8833a72ce tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:46.886492 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-581dd59c-3874-457c-a48c-b0e8833a72ce tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:46.887492 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-581dd59c-3874-457c-a48c-b0e8833a72ce tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:46.888778 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-581dd59c-3874-457c-a48c-b0e8833a72ce tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:46.889440 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-581dd59c-3874-457c-a48c-b0e8833a72ce tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:47.063195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-581dd59c-3874-457c-a48c-b0e8833a72ce tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:47.074505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-581dd59c-3874-457c-a48c-b0e8833a72ce tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1653 microversion: 2.1 time: 0.204984 Aug 26 15:53:47.084102 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 210/417] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:46 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1653 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:47.100278 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-cea3952d-ff41-4c34-953c-ea970b4fa18e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:47.107237 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cea3952d-ff41-4c34-953c-ea970b4fa18e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:47.108065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cea3952d-ff41-4c34-953c-ea970b4fa18e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:47.108731 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cea3952d-ff41-4c34-953c-ea970b4fa18e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:47.150775 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:47.156307 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-cea3952d-ff41-4c34-953c-ea970b4fa18e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Going to try to start instance {{(pid=127698) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 15:53:47.261760 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-4ae788cc-2d2f-4fee-a225-a7942eef29e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:47.266796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-4ae788cc-2d2f-4fee-a225-a7942eef29e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:47.280545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4ae788cc-2d2f-4fee-a225-a7942eef29e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:47.282124 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4ae788cc-2d2f-4fee-a225-a7942eef29e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:47.282583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4ae788cc-2d2f-4fee-a225-a7942eef29e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:47.284751 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4ae788cc-2d2f-4fee-a225-a7942eef29e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:47.285897 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4ae788cc-2d2f-4fee-a225-a7942eef29e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:47.286988 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4ae788cc-2d2f-4fee-a225-a7942eef29e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:47.412357 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-cea3952d-ff41-4c34-953c-ea970b4fa18e tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "POST /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/action" status: 202 len: 0 microversion: 2.1 time: 0.319802 Aug 26 15:53:47.416159 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 208/418] 10.222.0.98 () {60 vars in 1278 bytes} [Fri Aug 26 15:53:47 2022] POST /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:53:47.442499 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-21df70bb-24e9-4015-9f93-491eb681cd7a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:47.445237 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-21df70bb-24e9-4015-9f93-491eb681cd7a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:47.453421 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21df70bb-24e9-4015-9f93-491eb681cd7a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:47.453917 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21df70bb-24e9-4015-9f93-491eb681cd7a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:47.454425 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21df70bb-24e9-4015-9f93-491eb681cd7a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:47.455774 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21df70bb-24e9-4015-9f93-491eb681cd7a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:47.456310 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21df70bb-24e9-4015-9f93-491eb681cd7a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:47.456737 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21df70bb-24e9-4015-9f93-491eb681cd7a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:47.464586 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-4ae788cc-2d2f-4fee-a225-a7942eef29e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:47.474539 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-4ae788cc-2d2f-4fee-a225-a7942eef29e5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.222160 Aug 26 15:53:47.476012 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 211/419] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:47 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:47.698640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-21df70bb-24e9-4015-9f93-491eb681cd7a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:47.713762 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-21df70bb-24e9-4015-9f93-491eb681cd7a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1662 microversion: 2.1 time: 0.285727 Aug 26 15:53:47.731843 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 209/420] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:47 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1662 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:47.903630 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-4f39b5db-7a4e-451a-881b-8786e0bae7ee tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:47.904543 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-4f39b5db-7a4e-451a-881b-8786e0bae7ee tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:47.912084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4f39b5db-7a4e-451a-881b-8786e0bae7ee tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:47.912738 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4f39b5db-7a4e-451a-881b-8786e0bae7ee tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:47.913240 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4f39b5db-7a4e-451a-881b-8786e0bae7ee tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:47.914247 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4f39b5db-7a4e-451a-881b-8786e0bae7ee tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:47.914704 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4f39b5db-7a4e-451a-881b-8786e0bae7ee tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:47.915198 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4f39b5db-7a4e-451a-881b-8786e0bae7ee tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:48.121251 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-4f39b5db-7a4e-451a-881b-8786e0bae7ee tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:48.121824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-4f39b5db-7a4e-451a-881b-8786e0bae7ee tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1368 microversion: 2.1 time: 0.222027 Aug 26 15:53:48.123194 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 212/421] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:47 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:48.502629 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f26aa0a6-6614-4e7e-a266-58c3aafc138b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:48.514294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f26aa0a6-6614-4e7e-a266-58c3aafc138b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:48.528384 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f26aa0a6-6614-4e7e-a266-58c3aafc138b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:48.529369 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f26aa0a6-6614-4e7e-a266-58c3aafc138b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:48.530538 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f26aa0a6-6614-4e7e-a266-58c3aafc138b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:48.532861 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f26aa0a6-6614-4e7e-a266-58c3aafc138b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:48.535316 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f26aa0a6-6614-4e7e-a266-58c3aafc138b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:48.536128 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f26aa0a6-6614-4e7e-a266-58c3aafc138b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:48.734836 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-df8f1024-270d-410b-be8c-7dea839afbbd tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:48.735449 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-df8f1024-270d-410b-be8c-7dea839afbbd tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:48.745208 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f26aa0a6-6614-4e7e-a266-58c3aafc138b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:48.755911 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f26aa0a6-6614-4e7e-a266-58c3aafc138b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.257824 Aug 26 15:53:48.759343 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-df8f1024-270d-410b-be8c-7dea839afbbd tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:48.759921 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-df8f1024-270d-410b-be8c-7dea839afbbd tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:48.760598 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-df8f1024-270d-410b-be8c-7dea839afbbd tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:48.762103 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-df8f1024-270d-410b-be8c-7dea839afbbd tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:48.762752 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-df8f1024-270d-410b-be8c-7dea839afbbd tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:48.763361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-df8f1024-270d-410b-be8c-7dea839afbbd tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:48.771319 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 210/422] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:48 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:48.940166 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-df8f1024-270d-410b-be8c-7dea839afbbd tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:48.951537 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-df8f1024-270d-410b-be8c-7dea839afbbd tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1662 microversion: 2.1 time: 0.220569 Aug 26 15:53:48.952460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 213/423] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:48 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1662 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:49.145033 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-965ca40a-4fa8-4873-85c6-60bd6550e67d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:49.148740 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-965ca40a-4fa8-4873-85c6-60bd6550e67d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:49.153863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:49.160133 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-965ca40a-4fa8-4873-85c6-60bd6550e67d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:49.161149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-965ca40a-4fa8-4873-85c6-60bd6550e67d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:49.161967 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-965ca40a-4fa8-4873-85c6-60bd6550e67d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:49.163116 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-965ca40a-4fa8-4873-85c6-60bd6550e67d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:49.163661 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-965ca40a-4fa8-4873-85c6-60bd6550e67d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:49.164328 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-965ca40a-4fa8-4873-85c6-60bd6550e67d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:49.344577 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-aac3012e-7a0e-4436-82dd-d85d055a253f req-95b40669-449a-4bac-b8d4-1534c226d3ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af463f4-5ec2-4134-81cf-bd9adfc4853f", "name": "network-vif-plugged", "status": "completed", "tag": "539f60bc-cce0-48d0-b6bc-2e857f41b14d"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:49.355006 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-aac3012e-7a0e-4436-82dd-d85d055a253f req-95b40669-449a-4bac-b8d4-1534c226d3ae service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:49.369267 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-aac3012e-7a0e-4436-82dd-d85d055a253f req-95b40669-449a-4bac-b8d4-1534c226d3ae service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:49.369267 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-aac3012e-7a0e-4436-82dd-d85d055a253f req-95b40669-449a-4bac-b8d4-1534c226d3ae service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:49.369696 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-965ca40a-4fa8-4873-85c6-60bd6550e67d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:49.369962 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-aac3012e-7a0e-4436-82dd-d85d055a253f req-95b40669-449a-4bac-b8d4-1534c226d3ae service nova] Creating event network-vif-plugged:539f60bc-cce0-48d0-b6bc-2e857f41b14d for instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f on hv-cinder-83124 Aug 26 15:53:49.375603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-aac3012e-7a0e-4436-82dd-d85d055a253f req-95b40669-449a-4bac-b8d4-1534c226d3ae service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034772 Aug 26 15:53:49.376338 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 214/424] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:53:49.381042 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-965ca40a-4fa8-4873-85c6-60bd6550e67d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1368 microversion: 2.1 time: 0.242079 Aug 26 15:53:49.381628 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 211/425] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:49 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:49.779009 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-433da438-5b9b-43c9-a26f-4ab1148d9757 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:49.779715 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-433da438-5b9b-43c9-a26f-4ab1148d9757 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:49.786983 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-433da438-5b9b-43c9-a26f-4ab1148d9757 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:49.787540 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-433da438-5b9b-43c9-a26f-4ab1148d9757 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:49.788110 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-433da438-5b9b-43c9-a26f-4ab1148d9757 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:49.788733 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-433da438-5b9b-43c9-a26f-4ab1148d9757 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:49.789360 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-433da438-5b9b-43c9-a26f-4ab1148d9757 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:49.789786 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-433da438-5b9b-43c9-a26f-4ab1148d9757 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:49.941308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-433da438-5b9b-43c9-a26f-4ab1148d9757 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:49.950731 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-433da438-5b9b-43c9-a26f-4ab1148d9757 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.175991 Aug 26 15:53:49.952085 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 215/426] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:49 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:49.975704 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d822f4ea-79b3-4e24-9935-0618f7f12c62 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:49.976848 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d822f4ea-79b3-4e24-9935-0618f7f12c62 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:49.984227 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d822f4ea-79b3-4e24-9935-0618f7f12c62 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:49.984902 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d822f4ea-79b3-4e24-9935-0618f7f12c62 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:49.985454 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d822f4ea-79b3-4e24-9935-0618f7f12c62 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:49.986366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d822f4ea-79b3-4e24-9935-0618f7f12c62 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:49.987139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d822f4ea-79b3-4e24-9935-0618f7f12c62 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:49.987661 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d822f4ea-79b3-4e24-9935-0618f7f12c62 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:50.157182 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d822f4ea-79b3-4e24-9935-0618f7f12c62 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:50.165557 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d822f4ea-79b3-4e24-9935-0618f7f12c62 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1662 microversion: 2.1 time: 0.195716 Aug 26 15:53:50.166664 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 212/427] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:49 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1662 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:50.410227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9923f9a0-ba6b-4678-9e3b-06bdd2325140 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:50.411217 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9923f9a0-ba6b-4678-9e3b-06bdd2325140 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:50.417874 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9923f9a0-ba6b-4678-9e3b-06bdd2325140 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:50.418363 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9923f9a0-ba6b-4678-9e3b-06bdd2325140 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:50.418800 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9923f9a0-ba6b-4678-9e3b-06bdd2325140 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:50.419564 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9923f9a0-ba6b-4678-9e3b-06bdd2325140 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:50.420065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9923f9a0-ba6b-4678-9e3b-06bdd2325140 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:50.420486 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9923f9a0-ba6b-4678-9e3b-06bdd2325140 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:50.567994 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9923f9a0-ba6b-4678-9e3b-06bdd2325140 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:50.584992 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9923f9a0-ba6b-4678-9e3b-06bdd2325140 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1368 microversion: 2.1 time: 0.177314 Aug 26 15:53:50.584992 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 216/428] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:50 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:50.977058 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-07f716c2-68ad-45f0-a4e4-5858db25e4d4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:50.978243 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-07f716c2-68ad-45f0-a4e4-5858db25e4d4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:50.985917 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07f716c2-68ad-45f0-a4e4-5858db25e4d4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:50.987225 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07f716c2-68ad-45f0-a4e4-5858db25e4d4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:50.987664 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07f716c2-68ad-45f0-a4e4-5858db25e4d4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:50.988397 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07f716c2-68ad-45f0-a4e4-5858db25e4d4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:50.988851 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07f716c2-68ad-45f0-a4e4-5858db25e4d4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:50.989275 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07f716c2-68ad-45f0-a4e4-5858db25e4d4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:51.148571 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-07f716c2-68ad-45f0-a4e4-5858db25e4d4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:51.166278 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-07f716c2-68ad-45f0-a4e4-5858db25e4d4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.184608 Aug 26 15:53:51.166278 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 213/429] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:50 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:51.186652 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-06aacf0c-2f31-4b70-807d-1c741defba81 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:51.187426 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-06aacf0c-2f31-4b70-807d-1c741defba81 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:51.194805 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06aacf0c-2f31-4b70-807d-1c741defba81 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:51.195607 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06aacf0c-2f31-4b70-807d-1c741defba81 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:51.196282 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06aacf0c-2f31-4b70-807d-1c741defba81 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:51.197233 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06aacf0c-2f31-4b70-807d-1c741defba81 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:51.197915 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06aacf0c-2f31-4b70-807d-1c741defba81 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:51.198441 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06aacf0c-2f31-4b70-807d-1c741defba81 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:51.356380 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-06aacf0c-2f31-4b70-807d-1c741defba81 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:51.365899 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-06aacf0c-2f31-4b70-807d-1c741defba81 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1662 microversion: 2.1 time: 0.183187 Aug 26 15:53:51.366746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 217/430] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:51 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1662 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:51.605021 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-56da4443-44eb-4aee-9742-b6c43c6ae2b8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:51.606079 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-56da4443-44eb-4aee-9742-b6c43c6ae2b8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:51.615119 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-56da4443-44eb-4aee-9742-b6c43c6ae2b8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:51.615858 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-56da4443-44eb-4aee-9742-b6c43c6ae2b8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:51.616312 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-56da4443-44eb-4aee-9742-b6c43c6ae2b8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:51.617779 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-56da4443-44eb-4aee-9742-b6c43c6ae2b8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:51.618122 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-56da4443-44eb-4aee-9742-b6c43c6ae2b8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:51.618725 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-56da4443-44eb-4aee-9742-b6c43c6ae2b8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:51.769550 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-56da4443-44eb-4aee-9742-b6c43c6ae2b8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:51.778997 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-56da4443-44eb-4aee-9742-b6c43c6ae2b8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1368 microversion: 2.1 time: 0.177351 Aug 26 15:53:51.779201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 214/431] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:51 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:52.186730 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-403dbbda-1bc4-4fc6-80e2-54609095d120 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:52.187333 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-403dbbda-1bc4-4fc6-80e2-54609095d120 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:52.195658 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-403dbbda-1bc4-4fc6-80e2-54609095d120 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:52.196417 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-403dbbda-1bc4-4fc6-80e2-54609095d120 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:52.197107 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-403dbbda-1bc4-4fc6-80e2-54609095d120 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:52.197965 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-403dbbda-1bc4-4fc6-80e2-54609095d120 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:52.198602 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-403dbbda-1bc4-4fc6-80e2-54609095d120 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:52.199021 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-403dbbda-1bc4-4fc6-80e2-54609095d120 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:52.356863 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-403dbbda-1bc4-4fc6-80e2-54609095d120 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:52.363325 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-403dbbda-1bc4-4fc6-80e2-54609095d120 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.180686 Aug 26 15:53:52.364724 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 218/432] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:52 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:52.386748 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-18cedef8-be65-46a7-b115-d4e285b54ff8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:52.387406 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-18cedef8-be65-46a7-b115-d4e285b54ff8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:52.404291 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-18cedef8-be65-46a7-b115-d4e285b54ff8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:52.404800 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-18cedef8-be65-46a7-b115-d4e285b54ff8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:52.405231 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-18cedef8-be65-46a7-b115-d4e285b54ff8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:52.405945 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-18cedef8-be65-46a7-b115-d4e285b54ff8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:52.406517 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-18cedef8-be65-46a7-b115-d4e285b54ff8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:52.406952 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-18cedef8-be65-46a7-b115-d4e285b54ff8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:52.614940 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-18cedef8-be65-46a7-b115-d4e285b54ff8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:52.614940 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-18cedef8-be65-46a7-b115-d4e285b54ff8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1662 microversion: 2.1 time: 0.191422 Aug 26 15:53:52.614940 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 215/433] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:52 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1662 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:52.798533 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-76e26090-e450-4341-a1e2-81afb093de7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:52.799168 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-76e26090-e450-4341-a1e2-81afb093de7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:52.805367 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-76e26090-e450-4341-a1e2-81afb093de7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:52.805836 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-76e26090-e450-4341-a1e2-81afb093de7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:52.806273 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-76e26090-e450-4341-a1e2-81afb093de7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:52.806922 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-76e26090-e450-4341-a1e2-81afb093de7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:52.807606 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-76e26090-e450-4341-a1e2-81afb093de7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:52.807799 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-76e26090-e450-4341-a1e2-81afb093de7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:52.948233 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-76e26090-e450-4341-a1e2-81afb093de7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:52.956402 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-76e26090-e450-4341-a1e2-81afb093de7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1368 microversion: 2.1 time: 0.161696 Aug 26 15:53:52.956962 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 219/434] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:52 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:53.386520 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0a38a30a-7d64-4d24-a618-c162853c9d09 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:53.387220 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0a38a30a-7d64-4d24-a618-c162853c9d09 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:53.395198 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a38a30a-7d64-4d24-a618-c162853c9d09 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:53.395686 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a38a30a-7d64-4d24-a618-c162853c9d09 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:53.396204 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a38a30a-7d64-4d24-a618-c162853c9d09 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:53.396908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a38a30a-7d64-4d24-a618-c162853c9d09 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:53.397360 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a38a30a-7d64-4d24-a618-c162853c9d09 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:53.397782 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a38a30a-7d64-4d24-a618-c162853c9d09 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:53.542509 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0a38a30a-7d64-4d24-a618-c162853c9d09 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:53.552958 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0a38a30a-7d64-4d24-a618-c162853c9d09 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.170290 Aug 26 15:53:53.553545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 216/435] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:53 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:53.634570 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-62d35bf1-18a9-4293-ba06-5192c9ab6aac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:53.636123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-62d35bf1-18a9-4293-ba06-5192c9ab6aac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:53.643407 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-62d35bf1-18a9-4293-ba06-5192c9ab6aac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:53.644213 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-62d35bf1-18a9-4293-ba06-5192c9ab6aac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:53.644884 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-62d35bf1-18a9-4293-ba06-5192c9ab6aac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:53.645991 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-62d35bf1-18a9-4293-ba06-5192c9ab6aac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:53.646680 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-62d35bf1-18a9-4293-ba06-5192c9ab6aac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:53.647350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-62d35bf1-18a9-4293-ba06-5192c9ab6aac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:53.806220 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-62d35bf1-18a9-4293-ba06-5192c9ab6aac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:53.818490 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-62d35bf1-18a9-4293-ba06-5192c9ab6aac tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1666 microversion: 2.1 time: 0.187732 Aug 26 15:53:53.819541 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 220/436] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:53 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1666 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:53.979420 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c24fb8e6-e6e6-45a8-b6d8-80028cd2e209 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:53.980098 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c24fb8e6-e6e6-45a8-b6d8-80028cd2e209 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:53.986865 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c24fb8e6-e6e6-45a8-b6d8-80028cd2e209 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:53.988917 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c24fb8e6-e6e6-45a8-b6d8-80028cd2e209 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:53.988917 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c24fb8e6-e6e6-45a8-b6d8-80028cd2e209 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:53.988917 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c24fb8e6-e6e6-45a8-b6d8-80028cd2e209 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:53.989368 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c24fb8e6-e6e6-45a8-b6d8-80028cd2e209 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:53.989616 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c24fb8e6-e6e6-45a8-b6d8-80028cd2e209 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:54.142292 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c24fb8e6-e6e6-45a8-b6d8-80028cd2e209 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:54.151449 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c24fb8e6-e6e6-45a8-b6d8-80028cd2e209 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1368 microversion: 2.1 time: 0.176146 Aug 26 15:53:54.164587 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 217/437] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:53 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:54.574776 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-457a7344-e08a-422a-80bc-b175d133092f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:54.575829 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-457a7344-e08a-422a-80bc-b175d133092f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:54.585142 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-457a7344-e08a-422a-80bc-b175d133092f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:54.593628 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-457a7344-e08a-422a-80bc-b175d133092f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:54.593628 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-457a7344-e08a-422a-80bc-b175d133092f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:54.593628 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-457a7344-e08a-422a-80bc-b175d133092f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:54.593628 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-457a7344-e08a-422a-80bc-b175d133092f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:54.594074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-457a7344-e08a-422a-80bc-b175d133092f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:54.806560 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-457a7344-e08a-422a-80bc-b175d133092f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:54.817957 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-457a7344-e08a-422a-80bc-b175d133092f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.246905 Aug 26 15:53:54.818658 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 221/438] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:54 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:55.171911 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-82a7d785-03a0-463e-a33d-598b2c88ff99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:55.173125 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-82a7d785-03a0-463e-a33d-598b2c88ff99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:55.181596 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-82a7d785-03a0-463e-a33d-598b2c88ff99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:55.182279 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-82a7d785-03a0-463e-a33d-598b2c88ff99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:55.182691 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-82a7d785-03a0-463e-a33d-598b2c88ff99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:55.183458 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-82a7d785-03a0-463e-a33d-598b2c88ff99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:55.184253 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-82a7d785-03a0-463e-a33d-598b2c88ff99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:55.185035 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-82a7d785-03a0-463e-a33d-598b2c88ff99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:55.333794 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-82a7d785-03a0-463e-a33d-598b2c88ff99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:55.341928 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-82a7d785-03a0-463e-a33d-598b2c88ff99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1368 microversion: 2.1 time: 0.173831 Aug 26 15:53:55.342851 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 218/439] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:55 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:55.840073 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-4ff39325-60ac-42f5-8b50-aff20027369f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:55.841651 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-4ff39325-60ac-42f5-8b50-aff20027369f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:55.847763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4ff39325-60ac-42f5-8b50-aff20027369f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:55.848282 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4ff39325-60ac-42f5-8b50-aff20027369f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:55.848715 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4ff39325-60ac-42f5-8b50-aff20027369f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:55.849423 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4ff39325-60ac-42f5-8b50-aff20027369f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:55.849876 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4ff39325-60ac-42f5-8b50-aff20027369f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:55.850300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4ff39325-60ac-42f5-8b50-aff20027369f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:55.991241 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-4ff39325-60ac-42f5-8b50-aff20027369f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:56.000334 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-4ff39325-60ac-42f5-8b50-aff20027369f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.164160 Aug 26 15:53:56.000927 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 222/440] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:55 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:56.365737 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-64f9f5c7-4279-4e6f-8f3c-86384c542e8a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:56.366308 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-64f9f5c7-4279-4e6f-8f3c-86384c542e8a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:56.372812 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64f9f5c7-4279-4e6f-8f3c-86384c542e8a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:56.373347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64f9f5c7-4279-4e6f-8f3c-86384c542e8a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:56.373786 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64f9f5c7-4279-4e6f-8f3c-86384c542e8a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:56.374474 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64f9f5c7-4279-4e6f-8f3c-86384c542e8a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:56.374926 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64f9f5c7-4279-4e6f-8f3c-86384c542e8a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:56.375393 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64f9f5c7-4279-4e6f-8f3c-86384c542e8a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:56.523698 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-64f9f5c7-4279-4e6f-8f3c-86384c542e8a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:56.532349 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-64f9f5c7-4279-4e6f-8f3c-86384c542e8a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1368 microversion: 2.1 time: 0.171208 Aug 26 15:53:56.533172 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 219/441] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:56 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:57.023015 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-bab3bf06-b679-4fdc-a342-0b42eb7f7243 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:57.023581 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-bab3bf06-b679-4fdc-a342-0b42eb7f7243 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:57.030000 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bab3bf06-b679-4fdc-a342-0b42eb7f7243 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:57.030484 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bab3bf06-b679-4fdc-a342-0b42eb7f7243 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:57.030924 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bab3bf06-b679-4fdc-a342-0b42eb7f7243 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:57.031621 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bab3bf06-b679-4fdc-a342-0b42eb7f7243 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:57.032113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bab3bf06-b679-4fdc-a342-0b42eb7f7243 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:57.032538 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bab3bf06-b679-4fdc-a342-0b42eb7f7243 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:57.167720 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-bab3bf06-b679-4fdc-a342-0b42eb7f7243 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:57.176832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-bab3bf06-b679-4fdc-a342-0b42eb7f7243 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.157722 Aug 26 15:53:57.177416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 223/442] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:57 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:57.332991 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-aabe1841-a126-44d5-b7f1-f1577c3643f0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Action: 'create', calling method: .version_select at 0x7fbd1e4baaf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1995603639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfZ7/hM2zmPOIabeKNkiYvbtJeML6r6YyjE98d3M+UdPIoYNmlTg3LxjLiE8CCtouEbTyQYfx0J/CiDf/zpuBj4WuKy8rivbUTzrFDT1qiJh6MWFidZxSERn2Oplda1+Q=="}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:57.348099 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-aabe1841-a126-44d5-b7f1-f1577c3643f0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Getting quotas for project 1b64a7d4a15a4d019f7bfc17a59889a5. Resources: {'key_pairs'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:53:57.351801 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-aabe1841-a126-44d5-b7f1-f1577c3643f0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Getting quotas for user b0eb3bddc1bd4557a280ad21f9092093 and project 1b64a7d4a15a4d019f7bfc17a59889a5. Resources: {'key_pairs'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:53:57.419567 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-aabe1841-a126-44d5-b7f1-f1577c3643f0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.090325 Aug 26 15:53:57.420284 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 220/443] 10.222.0.98 () {60 vars in 1159 bytes} [Fri Aug 26 15:53:57 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:53:57.471164 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-504023725", "imageRef": "2f86b80e-1700-4e31-9d7e-b94460f05fcb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1995603639", "networks": [{"uuid": "908bb67d-0cbe-429c-8a55-ae215d1b8083"}]}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:53:57.524609 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.network.neutron [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] validate_networks() for [('908bb67d-0cbe-429c-8a55-ae215d1b8083', None, None, None, None, None)] {{(pid=127697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:53:57.554469 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7b94f995-a157-453b-8168-6c1207d411c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:57.555088 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7b94f995-a157-453b-8168-6c1207d411c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:57.561207 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b94f995-a157-453b-8168-6c1207d411c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:57.561690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b94f995-a157-453b-8168-6c1207d411c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:57.562126 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b94f995-a157-453b-8168-6c1207d411c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:57.562881 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b94f995-a157-453b-8168-6c1207d411c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:57.563274 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b94f995-a157-453b-8168-6c1207d411c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:57.563696 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b94f995-a157-453b-8168-6c1207d411c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:57.697818 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7b94f995-a157-453b-8168-6c1207d411c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:57.705689 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7b94f995-a157-453b-8168-6c1207d411c3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1368 microversion: 2.1 time: 0.155067 Aug 26 15:53:57.706267 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 221/444] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:57 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:57.901734 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Flavor limits 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:53:57.902156 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Image limits 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:53:57.902626 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Flavor pref 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:53:57.903064 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Image pref 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:53:57.903489 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:53:57.912886 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:57.913363 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:57.913802 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:57.914529 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:57.914985 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:57.915419 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:57.932446 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Getting quotas for project 1b64a7d4a15a4d019f7bfc17a59889a5. Resources: {'ram', 'cores', 'instances'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:53:57.936401 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Getting quotas for user b0eb3bddc1bd4557a280ad21f9092093 and project 1b64a7d4a15a4d019f7bfc17a59889a5. Resources: {'ram', 'cores', 'instances'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:53:57.947756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Going to run 1 instances... {{(pid=127697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:53:57.950027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f86b80e-1700-4e31-9d7e-b94460f05fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:53:58.135145 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f48ecc0d-a539-42c9-8c52-3e2a1703554b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667720 Aug 26 15:53:58.136921 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 224/445] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:53:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:53:58.149527 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-debd8bfd-3c34-4bf7-ac67-fec3c7af9818 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:58.150145 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-debd8bfd-3c34-4bf7-ac67-fec3c7af9818 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:58.199458 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-4071344b-64c8-4ad7-b34f-bcdadbdd1501 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:58.200273 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-4071344b-64c8-4ad7-b34f-bcdadbdd1501 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:58.207466 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4071344b-64c8-4ad7-b34f-bcdadbdd1501 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:58.208262 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4071344b-64c8-4ad7-b34f-bcdadbdd1501 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:58.208759 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4071344b-64c8-4ad7-b34f-bcdadbdd1501 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:58.209999 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4071344b-64c8-4ad7-b34f-bcdadbdd1501 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:58.210733 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4071344b-64c8-4ad7-b34f-bcdadbdd1501 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:58.211016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-debd8bfd-3c34-4bf7-ac67-fec3c7af9818 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:58.211142 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4071344b-64c8-4ad7-b34f-bcdadbdd1501 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:58.216690 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=100 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:58.219377 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-debd8bfd-3c34-4bf7-ac67-fec3c7af9818 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1258 microversion: 2.1 time: 0.075042 Aug 26 15:53:58.220370 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 222/446] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:58 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:58.361505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-4071344b-64c8-4ad7-b34f-bcdadbdd1501 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:58.369785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-4071344b-64c8-4ad7-b34f-bcdadbdd1501 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.174695 Aug 26 15:53:58.377365 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 225/447] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:58 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:58.727140 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7dcc2fd9-f789-443d-9613-704a9a06ba9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:58.727839 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7dcc2fd9-f789-443d-9613-704a9a06ba9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:58.734894 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7dcc2fd9-f789-443d-9613-704a9a06ba9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:58.735380 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7dcc2fd9-f789-443d-9613-704a9a06ba9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:58.735828 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7dcc2fd9-f789-443d-9613-704a9a06ba9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:58.736550 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7dcc2fd9-f789-443d-9613-704a9a06ba9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:58.736995 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7dcc2fd9-f789-443d-9613-704a9a06ba9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:58.737499 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7dcc2fd9-f789-443d-9613-704a9a06ba9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:58.888778 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7dcc2fd9-f789-443d-9613-704a9a06ba9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:58.899845 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7dcc2fd9-f789-443d-9613-704a9a06ba9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1557 microversion: 2.1 time: 0.176302 Aug 26 15:53:58.901085 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 223/448] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:58 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:53:58.928423 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f52ad979-f927-44cd-a134-4432e76e9cfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:58.928982 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f52ad979-f927-44cd-a134-4432e76e9cfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:58.935068 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f52ad979-f927-44cd-a134-4432e76e9cfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:58.936927 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f52ad979-f927-44cd-a134-4432e76e9cfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:58.936927 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f52ad979-f927-44cd-a134-4432e76e9cfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:58.936927 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f52ad979-f927-44cd-a134-4432e76e9cfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:58.937409 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f52ad979-f927-44cd-a134-4432e76e9cfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:58.937832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f52ad979-f927-44cd-a134-4432e76e9cfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:59.023857 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f52ad979-f927-44cd-a134-4432e76e9cfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099961 Aug 26 15:53:59.024489 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 226/449] 10.222.0.98 () {58 vars in 1275 bytes} [Fri Aug 26 15:53:58 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:53:59.247974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-edd82a2d-dc9f-43e4-b700-51efb62cb4c0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:59.247974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-edd82a2d-dc9f-43e4-b700-51efb62cb4c0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:59.312982 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-edd82a2d-dc9f-43e4-b700-51efb62cb4c0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:59.320441 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-edd82a2d-dc9f-43e4-b700-51efb62cb4c0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1258 microversion: 2.1 time: 0.083713 Aug 26 15:53:59.321023 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 224/450] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:59 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1258 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:53:59.392557 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-2f267827-6a35-4e79-b57b-ce70c5d39375 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:53:59.393163 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-2f267827-6a35-4e79-b57b-ce70c5d39375 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:53:59.395202 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:59.399977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2f267827-6a35-4e79-b57b-ce70c5d39375 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:59.400462 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2f267827-6a35-4e79-b57b-ce70c5d39375 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:59.400912 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2f267827-6a35-4e79-b57b-ce70c5d39375 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:59.401601 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2f267827-6a35-4e79-b57b-ce70c5d39375 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:53:59.402051 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2f267827-6a35-4e79-b57b-ce70c5d39375 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:53:59.402463 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2f267827-6a35-4e79-b57b-ce70c5d39375 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:53:59.632147 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2f267827-6a35-4e79-b57b-ce70c5d39375 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:53:59.640492 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-2f267827-6a35-4e79-b57b-ce70c5d39375 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.252666 Aug 26 15:53:59.641078 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 227/451] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:53:59 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:00.340606 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-29c4fc60-6644-446b-ac2c-73df933ed421 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:00.341257 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-29c4fc60-6644-446b-ac2c-73df933ed421 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:00.349765 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-29c4fc60-6644-446b-ac2c-73df933ed421 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:00.350256 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-29c4fc60-6644-446b-ac2c-73df933ed421 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:00.350691 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-29c4fc60-6644-446b-ac2c-73df933ed421 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:00.351454 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-29c4fc60-6644-446b-ac2c-73df933ed421 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:00.351935 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-29c4fc60-6644-446b-ac2c-73df933ed421 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:00.352361 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-29c4fc60-6644-446b-ac2c-73df933ed421 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:00.368694 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-487cfeb9-6e07-4eb6-aa0e-4b4e5c03fabb req-6998d20c-282c-4c72-befc-285d690db433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af463f4-5ec2-4134-81cf-bd9adfc4853f", "tag": "539f60bc-cce0-48d0-b6bc-2e857f41b14d"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:00.382460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-487cfeb9-6e07-4eb6-aa0e-4b4e5c03fabb req-6998d20c-282c-4c72-befc-285d690db433 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:00.383155 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-487cfeb9-6e07-4eb6-aa0e-4b4e5c03fabb req-6998d20c-282c-4c72-befc-285d690db433 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:00.385930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-487cfeb9-6e07-4eb6-aa0e-4b4e5c03fabb req-6998d20c-282c-4c72-befc-285d690db433 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:00.399632 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-487cfeb9-6e07-4eb6-aa0e-4b4e5c03fabb req-6998d20c-282c-4c72-befc-285d690db433 service nova] Creating event network-changed:539f60bc-cce0-48d0-b6bc-2e857f41b14d for instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f on hv-cinder-83124 Aug 26 15:54:00.405763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-487cfeb9-6e07-4eb6-aa0e-4b4e5c03fabb req-6998d20c-282c-4c72-befc-285d690db433 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040735 Aug 26 15:54:00.406381 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 228/452] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:00.425619 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-29c4fc60-6644-446b-ac2c-73df933ed421 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:00.433867 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-29c4fc60-6644-446b-ac2c-73df933ed421 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1254 microversion: 2.1 time: 0.096969 Aug 26 15:54:00.434392 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 225/453] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:00 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1254 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:00.663899 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-cc055134-06ec-4038-82cf-d398dc96cd4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:00.664613 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-cc055134-06ec-4038-82cf-d398dc96cd4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:00.670994 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cc055134-06ec-4038-82cf-d398dc96cd4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:00.671511 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cc055134-06ec-4038-82cf-d398dc96cd4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:00.671976 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cc055134-06ec-4038-82cf-d398dc96cd4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:00.672814 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cc055134-06ec-4038-82cf-d398dc96cd4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:00.673272 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cc055134-06ec-4038-82cf-d398dc96cd4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:00.673715 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cc055134-06ec-4038-82cf-d398dc96cd4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:00.807306 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cc055134-06ec-4038-82cf-d398dc96cd4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:00.816248 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-cc055134-06ec-4038-82cf-d398dc96cd4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.157451 Aug 26 15:54:00.816853 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 229/454] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:00 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:01.455325 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e013deb5-d987-4f0d-9377-dc13418543f9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:01.455996 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e013deb5-d987-4f0d-9377-dc13418543f9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:01.462571 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e013deb5-d987-4f0d-9377-dc13418543f9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:01.463064 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e013deb5-d987-4f0d-9377-dc13418543f9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:01.463500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e013deb5-d987-4f0d-9377-dc13418543f9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:01.464253 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e013deb5-d987-4f0d-9377-dc13418543f9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:01.464708 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e013deb5-d987-4f0d-9377-dc13418543f9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:01.465129 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e013deb5-d987-4f0d-9377-dc13418543f9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:01.528307 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e013deb5-d987-4f0d-9377-dc13418543f9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:01.536560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e013deb5-d987-4f0d-9377-dc13418543f9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1254 microversion: 2.1 time: 0.085215 Aug 26 15:54:01.537134 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 226/455] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:01 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1254 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:01.837692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9b88cdbb-7f37-4205-9082-4fae1dd7b7dc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:01.838304 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9b88cdbb-7f37-4205-9082-4fae1dd7b7dc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:01.844971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b88cdbb-7f37-4205-9082-4fae1dd7b7dc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:01.845451 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b88cdbb-7f37-4205-9082-4fae1dd7b7dc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:01.845887 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b88cdbb-7f37-4205-9082-4fae1dd7b7dc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:01.847176 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b88cdbb-7f37-4205-9082-4fae1dd7b7dc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:01.847630 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b88cdbb-7f37-4205-9082-4fae1dd7b7dc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:01.848088 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9b88cdbb-7f37-4205-9082-4fae1dd7b7dc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:01.977269 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9b88cdbb-7f37-4205-9082-4fae1dd7b7dc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:01.985468 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9b88cdbb-7f37-4205-9082-4fae1dd7b7dc tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.151658 Aug 26 15:54:01.986036 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 230/456] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:01 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:02.557668 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0ee7e655-26cf-430e-830d-681dc32a817b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:02.558205 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0ee7e655-26cf-430e-830d-681dc32a817b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:02.564582 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ee7e655-26cf-430e-830d-681dc32a817b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:02.565678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ee7e655-26cf-430e-830d-681dc32a817b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:02.566105 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ee7e655-26cf-430e-830d-681dc32a817b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:02.566784 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ee7e655-26cf-430e-830d-681dc32a817b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:02.567226 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ee7e655-26cf-430e-830d-681dc32a817b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:02.567638 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ee7e655-26cf-430e-830d-681dc32a817b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:02.571811 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:02.628037 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0ee7e655-26cf-430e-830d-681dc32a817b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:02.635653 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0ee7e655-26cf-430e-830d-681dc32a817b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1254 microversion: 2.1 time: 0.081894 Aug 26 15:54:02.636260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 227/457] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:02 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1254 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:03.006815 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-09746197-ca29-4541-9f97-58076c2cc20c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:03.007425 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-09746197-ca29-4541-9f97-58076c2cc20c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:03.014009 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09746197-ca29-4541-9f97-58076c2cc20c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:03.014538 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09746197-ca29-4541-9f97-58076c2cc20c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:03.014962 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09746197-ca29-4541-9f97-58076c2cc20c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:03.015653 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09746197-ca29-4541-9f97-58076c2cc20c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:03.016134 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09746197-ca29-4541-9f97-58076c2cc20c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:03.016565 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09746197-ca29-4541-9f97-58076c2cc20c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:03.147431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-09746197-ca29-4541-9f97-58076c2cc20c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:03.155655 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-09746197-ca29-4541-9f97-58076c2cc20c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.152688 Aug 26 15:54:03.156259 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 231/458] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:03 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:03.656566 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-6cdb2947-de0e-4f75-9a4f-8455402838c1 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:03.657177 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-6cdb2947-de0e-4f75-9a4f-8455402838c1 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:03.664510 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6cdb2947-de0e-4f75-9a4f-8455402838c1 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:03.664974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6cdb2947-de0e-4f75-9a4f-8455402838c1 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:03.665405 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6cdb2947-de0e-4f75-9a4f-8455402838c1 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:03.666086 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6cdb2947-de0e-4f75-9a4f-8455402838c1 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:03.666557 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6cdb2947-de0e-4f75-9a4f-8455402838c1 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:03.666978 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6cdb2947-de0e-4f75-9a4f-8455402838c1 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:03.731299 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-6cdb2947-de0e-4f75-9a4f-8455402838c1 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:03.739056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-6cdb2947-de0e-4f75-9a4f-8455402838c1 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1310 microversion: 2.1 time: 0.086506 Aug 26 15:54:03.741576 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 228/459] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:03 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:04.178373 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f3e56de1-78db-43e3-96dc-80b777def0ef tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:04.179018 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f3e56de1-78db-43e3-96dc-80b777def0ef tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:04.185542 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f3e56de1-78db-43e3-96dc-80b777def0ef tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:04.186081 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f3e56de1-78db-43e3-96dc-80b777def0ef tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:04.186518 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f3e56de1-78db-43e3-96dc-80b777def0ef tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:04.187202 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f3e56de1-78db-43e3-96dc-80b777def0ef tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:04.187645 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f3e56de1-78db-43e3-96dc-80b777def0ef tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:04.188089 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f3e56de1-78db-43e3-96dc-80b777def0ef tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:04.321493 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f3e56de1-78db-43e3-96dc-80b777def0ef tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:04.330053 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f3e56de1-78db-43e3-96dc-80b777def0ef tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1736 microversion: 2.1 time: 0.156110 Aug 26 15:54:04.330631 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 232/460] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:04 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:04.760177 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0a8e3e9b-2958-48f1-a47d-16d050b915ba tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:04.760794 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0a8e3e9b-2958-48f1-a47d-16d050b915ba tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:04.767434 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a8e3e9b-2958-48f1-a47d-16d050b915ba tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:04.768551 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a8e3e9b-2958-48f1-a47d-16d050b915ba tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:04.768992 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a8e3e9b-2958-48f1-a47d-16d050b915ba tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:04.769696 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a8e3e9b-2958-48f1-a47d-16d050b915ba tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:04.770147 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a8e3e9b-2958-48f1-a47d-16d050b915ba tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:04.770569 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0a8e3e9b-2958-48f1-a47d-16d050b915ba tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:04.833226 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0a8e3e9b-2958-48f1-a47d-16d050b915ba tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:04.840913 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0a8e3e9b-2958-48f1-a47d-16d050b915ba tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1310 microversion: 2.1 time: 0.084650 Aug 26 15:54:04.841488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 229/461] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:04 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:05.352011 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-8b9c0b62-ce1d-4b26-8d6d-cfb2473edff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:05.352638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-8b9c0b62-ce1d-4b26-8d6d-cfb2473edff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:05.359325 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8b9c0b62-ce1d-4b26-8d6d-cfb2473edff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:05.359800 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8b9c0b62-ce1d-4b26-8d6d-cfb2473edff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:05.365501 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8b9c0b62-ce1d-4b26-8d6d-cfb2473edff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:05.365501 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8b9c0b62-ce1d-4b26-8d6d-cfb2473edff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:05.365501 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8b9c0b62-ce1d-4b26-8d6d-cfb2473edff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:05.365501 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8b9c0b62-ce1d-4b26-8d6d-cfb2473edff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:05.499470 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-8b9c0b62-ce1d-4b26-8d6d-cfb2473edff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:05.511097 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-8b9c0b62-ce1d-4b26-8d6d-cfb2473edff5 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1716 microversion: 2.1 time: 0.163312 Aug 26 15:54:05.512113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 233/462] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:05 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1716 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:05.632923 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ce93999b-a3ae-4606-a82f-026d4ee54db0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:05.633494 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ce93999b-a3ae-4606-a82f-026d4ee54db0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:05.644151 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ce93999b-a3ae-4606-a82f-026d4ee54db0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:05.644888 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ce93999b-a3ae-4606-a82f-026d4ee54db0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:05.645470 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ce93999b-a3ae-4606-a82f-026d4ee54db0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:05.646191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ce93999b-a3ae-4606-a82f-026d4ee54db0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:05.646650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ce93999b-a3ae-4606-a82f-026d4ee54db0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:05.647126 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ce93999b-a3ae-4606-a82f-026d4ee54db0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:05.733157 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-ce93999b-a3ae-4606-a82f-026d4ee54db0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] HTTP exception thrown: Cannot 'detach_volume' instance 08d976c8-85c3-48de-80ba-93fdff79445a while it is in vm_state rescued Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ce93999b-a3ae-4606-a82f-026d4ee54db0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Request method failure captured: Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: DELETE /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments/1145727f-9298-496b-955c-b995f6c62dfe HTTP/1.1 Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOu4mB4haQKordFhuZBlwEB2sjzB1Ggq0RGqd_gZMlk7fOoxmsTjHxDr7EkB7u8NObi4d6APbLdClBiJmlJAqHVshko5l_rzaX5t4_54zFPQBeYab44MgJPCU1k-0j6OBkr3q7IvEClkDHMwJxZPzPX7sgNHTQ4qdi7FVVy-db3TXrw Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: 853df33daae14bd9825788afd555e11a Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1564618252 Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:54:05.736970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:54:05.738713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/853df33daae14bd9825788afd555e11a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_853df33daae14bd9825788afd555e11a", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/853df33daae14bd9825788afd555e11a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/853df33daae14bd9825788afd555e11a"}]}] Aug 26 15:54:05.738713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1564618252 Aug 26 15:54:05.738713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: 853df33daae14bd9825788afd555e11a Aug 26 15:54:05.738713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1564618252 Aug 26 15:54:05.738713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-ServerRescueNegativeTestJSON-1564618252-project Aug 26 15:54:05.738713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:54:05.738713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:54:05.738713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 5c01a893d3ab42cc97508768791ff38e Aug 26 15:54:05.738713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1564618252-project Aug 26 15:54:05.738713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:54:05.738713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Cannot 'detach_volume' instance 08d976c8-85c3-48de-80ba-93fdff79445a while it is in vm_state rescued Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'server_id': '08d976c8-85c3-48de-80ba-93fdff79445a', 'id': '1145727f-9298-496b-955c-b995f6c62dfe'} Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08d976c8-85c3-48de-80ba-93fdff79445a in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:54:05.739481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 08d976c8-85c3-48de-80ba-93fdff79445a while it is in vm_state rescued Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 08d976c8-85c3-48de-80ba-93fdff79445a while it is in vm_state rescued Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:54:05.741047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ce93999b-a3ae-4606-a82f-026d4ee54db0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Returning 409 to user: Cannot 'detach_volume' instance 08d976c8-85c3-48de-80ba-93fdff79445a while it is in vm_state rescued {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:54:05.742031 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ce93999b-a3ae-4606-a82f-026d4ee54db0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "DELETE /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments/1145727f-9298-496b-955c-b995f6c62dfe" status: 409 len: 152 microversion: 2.1 time: 0.107260 Aug 26 15:54:05.742031 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 230/463] 10.222.0.98 () {58 vars in 1416 bytes} [Fri Aug 26 15:54:05 2022] DELETE /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments/1145727f-9298-496b-955c-b995f6c62dfe => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 26 15:54:05.745039 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-842401b5-f453-465b-ba0d-bfa24f421044 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:05.745587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-842401b5-f453-465b-ba0d-bfa24f421044 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:05.751495 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-842401b5-f453-465b-ba0d-bfa24f421044 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:05.752019 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-842401b5-f453-465b-ba0d-bfa24f421044 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:05.752500 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-842401b5-f453-465b-ba0d-bfa24f421044 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:05.753195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-842401b5-f453-465b-ba0d-bfa24f421044 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:05.753650 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-842401b5-f453-465b-ba0d-bfa24f421044 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:05.754073 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-842401b5-f453-465b-ba0d-bfa24f421044 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:05.862861 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-50858556-a636-43d6-bd45-3a0cd35a5cbe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:05.864166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-50858556-a636-43d6-bd45-3a0cd35a5cbe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:05.871719 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-50858556-a636-43d6-bd45-3a0cd35a5cbe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:05.872245 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-50858556-a636-43d6-bd45-3a0cd35a5cbe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:05.872685 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-50858556-a636-43d6-bd45-3a0cd35a5cbe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:05.873377 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-50858556-a636-43d6-bd45-3a0cd35a5cbe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:05.873826 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-50858556-a636-43d6-bd45-3a0cd35a5cbe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:05.874249 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-50858556-a636-43d6-bd45-3a0cd35a5cbe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:05.953452 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-50858556-a636-43d6-bd45-3a0cd35a5cbe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:05.966536 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-50858556-a636-43d6-bd45-3a0cd35a5cbe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1318 microversion: 2.1 time: 0.107657 Aug 26 15:54:05.967126 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 231/464] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:05 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1318 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:54:06.010659 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-842401b5-f453-465b-ba0d-bfa24f421044 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "POST /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/action" status: 202 len: 0 microversion: 2.1 time: 0.269255 Aug 26 15:54:06.011322 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 234/465] 10.222.0.98 () {60 vars in 1278 bytes} [Fri Aug 26 15:54:05 2022] POST /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:54:06.020513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d54e0429-6ddc-4b89-b1f7-493e4470bcf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:06.021383 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d54e0429-6ddc-4b89-b1f7-493e4470bcf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:06.027971 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d54e0429-6ddc-4b89-b1f7-493e4470bcf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:06.028568 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d54e0429-6ddc-4b89-b1f7-493e4470bcf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:06.029068 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d54e0429-6ddc-4b89-b1f7-493e4470bcf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:06.029890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d54e0429-6ddc-4b89-b1f7-493e4470bcf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:06.030401 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d54e0429-6ddc-4b89-b1f7-493e4470bcf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:06.031133 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d54e0429-6ddc-4b89-b1f7-493e4470bcf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:06.197844 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d54e0429-6ddc-4b89-b1f7-493e4470bcf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:06.207600 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d54e0429-6ddc-4b89-b1f7-493e4470bcf6 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1724 microversion: 2.1 time: 0.191876 Aug 26 15:54:06.208261 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 232/466] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:06 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:06.991755 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7882f073-4496-48c2-bf08-a35a13582d89 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:06.993702 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-44b488ec-7dfc-4de0-a3fb-3b23fe393d91 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:06.994803 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7882f073-4496-48c2-bf08-a35a13582d89 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:06.995735 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-44b488ec-7dfc-4de0-a3fb-3b23fe393d91 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:07.006888 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44b488ec-7dfc-4de0-a3fb-3b23fe393d91 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:07.007372 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44b488ec-7dfc-4de0-a3fb-3b23fe393d91 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:07.007807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44b488ec-7dfc-4de0-a3fb-3b23fe393d91 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:07.011433 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7882f073-4496-48c2-bf08-a35a13582d89 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:07.011964 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7882f073-4496-48c2-bf08-a35a13582d89 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:07.012396 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7882f073-4496-48c2-bf08-a35a13582d89 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:07.013090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7882f073-4496-48c2-bf08-a35a13582d89 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:07.014111 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44b488ec-7dfc-4de0-a3fb-3b23fe393d91 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:07.014730 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7882f073-4496-48c2-bf08-a35a13582d89 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:07.015383 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7882f073-4496-48c2-bf08-a35a13582d89 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:07.020508 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44b488ec-7dfc-4de0-a3fb-3b23fe393d91 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:07.021151 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-44b488ec-7dfc-4de0-a3fb-3b23fe393d91 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:07.157932 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-7882f073-4496-48c2-bf08-a35a13582d89 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lazy-loading 'services' on Instance uuid ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:54:07.236467 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-44b488ec-7dfc-4de0-a3fb-3b23fe393d91 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:07.246591 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-44b488ec-7dfc-4de0-a3fb-3b23fe393d91 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.263433 Aug 26 15:54:07.248056 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 235/467] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:06 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:07.260362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-58e6fe6a-35b5-4c30-ba40-ce3572772ba3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:07.261052 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-58e6fe6a-35b5-4c30-ba40-ce3572772ba3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:07.268195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-58e6fe6a-35b5-4c30-ba40-ce3572772ba3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:07.269092 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-58e6fe6a-35b5-4c30-ba40-ce3572772ba3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:07.269976 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-58e6fe6a-35b5-4c30-ba40-ce3572772ba3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:07.270993 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-58e6fe6a-35b5-4c30-ba40-ce3572772ba3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:07.271678 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-58e6fe6a-35b5-4c30-ba40-ce3572772ba3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:07.272348 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-58e6fe6a-35b5-4c30-ba40-ce3572772ba3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:07.406068 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7882f073-4496-48c2-bf08-a35a13582d89 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "DELETE /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33/os-volume_attachments/1e87f654-4aa0-447d-9ca9-337e3921ae87" status: 202 len: 0 microversion: 2.1 time: 0.418213 Aug 26 15:54:07.406646 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 233/468] 10.222.0.98 () {58 vars in 1416 bytes} [Fri Aug 26 15:54:06 2022] DELETE /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33/os-volume_attachments/1e87f654-4aa0-447d-9ca9-337e3921ae87 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 15:54:07.430969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-58e6fe6a-35b5-4c30-ba40-ce3572772ba3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:07.451006 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-58e6fe6a-35b5-4c30-ba40-ce3572772ba3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1724 microversion: 2.1 time: 0.200946 Aug 26 15:54:07.453131 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 236/469] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:07 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:08.276742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-256f7db2-dc76-4250-a48e-5c7dad366de2 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:08.277472 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-256f7db2-dc76-4250-a48e-5c7dad366de2 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:08.284418 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-256f7db2-dc76-4250-a48e-5c7dad366de2 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:08.285064 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-256f7db2-dc76-4250-a48e-5c7dad366de2 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:08.285688 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-256f7db2-dc76-4250-a48e-5c7dad366de2 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:08.286466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-256f7db2-dc76-4250-a48e-5c7dad366de2 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:08.287432 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-256f7db2-dc76-4250-a48e-5c7dad366de2 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:08.287532 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-256f7db2-dc76-4250-a48e-5c7dad366de2 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:08.432526 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-256f7db2-dc76-4250-a48e-5c7dad366de2 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:08.441244 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-256f7db2-dc76-4250-a48e-5c7dad366de2 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.169567 Aug 26 15:54:08.441809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 234/470] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:08 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:08.473856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-ea390bbe-69de-41e3-8fd2-ca659e52d11f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:08.474490 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ea390bbe-69de-41e3-8fd2-ca659e52d11f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:08.476512 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:08.477261 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=6 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:08.482117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ea390bbe-69de-41e3-8fd2-ca659e52d11f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:08.494971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ea390bbe-69de-41e3-8fd2-ca659e52d11f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:08.494971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ea390bbe-69de-41e3-8fd2-ca659e52d11f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:08.494971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ea390bbe-69de-41e3-8fd2-ca659e52d11f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:08.494971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ea390bbe-69de-41e3-8fd2-ca659e52d11f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:08.496081 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ea390bbe-69de-41e3-8fd2-ca659e52d11f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:08.634234 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ea390bbe-69de-41e3-8fd2-ca659e52d11f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:08.643201 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-ea390bbe-69de-41e3-8fd2-ca659e52d11f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1724 microversion: 2.1 time: 0.173116 Aug 26 15:54:08.643906 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 237/471] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:08 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:09.462961 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c393f8d2-b9cd-40f5-89cd-7159e12342ab tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:09.463592 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c393f8d2-b9cd-40f5-89cd-7159e12342ab tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:09.465993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=8 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:09.471792 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c393f8d2-b9cd-40f5-89cd-7159e12342ab tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:09.474065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c393f8d2-b9cd-40f5-89cd-7159e12342ab tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:09.474065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c393f8d2-b9cd-40f5-89cd-7159e12342ab tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:09.474295 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c393f8d2-b9cd-40f5-89cd-7159e12342ab tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:09.474681 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c393f8d2-b9cd-40f5-89cd-7159e12342ab tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:09.475103 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c393f8d2-b9cd-40f5-89cd-7159e12342ab tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:09.642891 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c393f8d2-b9cd-40f5-89cd-7159e12342ab tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:09.651527 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c393f8d2-b9cd-40f5-89cd-7159e12342ab tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.192284 Aug 26 15:54:09.664346 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 235/472] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:09 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:09.665715 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-09ef6b88-21e4-4593-96d6-5535cb97c03f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:09.666404 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-09ef6b88-21e4-4593-96d6-5535cb97c03f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:09.675411 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09ef6b88-21e4-4593-96d6-5535cb97c03f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:09.683973 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09ef6b88-21e4-4593-96d6-5535cb97c03f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:09.684651 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09ef6b88-21e4-4593-96d6-5535cb97c03f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:09.685767 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09ef6b88-21e4-4593-96d6-5535cb97c03f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:09.686244 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09ef6b88-21e4-4593-96d6-5535cb97c03f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:09.686738 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-09ef6b88-21e4-4593-96d6-5535cb97c03f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:09.837956 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-09ef6b88-21e4-4593-96d6-5535cb97c03f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:09.848677 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-09ef6b88-21e4-4593-96d6-5535cb97c03f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1724 microversion: 2.1 time: 0.188050 Aug 26 15:54:09.860052 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 238/473] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:09 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:10.677302 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-21001c20-aace-4dd9-8551-46197d0f8373 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:10.678659 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-21001c20-aace-4dd9-8551-46197d0f8373 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:10.686684 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21001c20-aace-4dd9-8551-46197d0f8373 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:10.687846 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21001c20-aace-4dd9-8551-46197d0f8373 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:10.695191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21001c20-aace-4dd9-8551-46197d0f8373 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:10.695191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21001c20-aace-4dd9-8551-46197d0f8373 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:10.695191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21001c20-aace-4dd9-8551-46197d0f8373 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:10.695191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-21001c20-aace-4dd9-8551-46197d0f8373 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:10.832096 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-21001c20-aace-4dd9-8551-46197d0f8373 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:10.841081 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-21001c20-aace-4dd9-8551-46197d0f8373 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.171043 Aug 26 15:54:10.842112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 236/474] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:10 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:10.871040 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-91f774ff-be40-483c-bfc3-b2f9a847625f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:10.871648 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-91f774ff-be40-483c-bfc3-b2f9a847625f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:10.878302 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-91f774ff-be40-483c-bfc3-b2f9a847625f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:10.878788 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-91f774ff-be40-483c-bfc3-b2f9a847625f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:10.879247 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-91f774ff-be40-483c-bfc3-b2f9a847625f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:10.879954 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-91f774ff-be40-483c-bfc3-b2f9a847625f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:10.880406 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-91f774ff-be40-483c-bfc3-b2f9a847625f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:10.880831 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-91f774ff-be40-483c-bfc3-b2f9a847625f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:11.018137 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-91f774ff-be40-483c-bfc3-b2f9a847625f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:11.027404 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-91f774ff-be40-483c-bfc3-b2f9a847625f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1724 microversion: 2.1 time: 0.160396 Aug 26 15:54:11.028059 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 239/475] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:10 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:11.863049 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4944a090-69c1-4d63-9d14-66a2788bd072 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:11.863710 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-4944a090-69c1-4d63-9d14-66a2788bd072 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:11.870264 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4944a090-69c1-4d63-9d14-66a2788bd072 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:11.870759 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4944a090-69c1-4d63-9d14-66a2788bd072 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:11.871217 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4944a090-69c1-4d63-9d14-66a2788bd072 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:11.871968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4944a090-69c1-4d63-9d14-66a2788bd072 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:11.872457 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4944a090-69c1-4d63-9d14-66a2788bd072 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:11.872914 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4944a090-69c1-4d63-9d14-66a2788bd072 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:12.012016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4944a090-69c1-4d63-9d14-66a2788bd072 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:12.020170 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4944a090-69c1-4d63-9d14-66a2788bd072 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.161002 Aug 26 15:54:12.028585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 237/476] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:11 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:12.049778 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-04ab1532-9b5a-4feb-b23c-793e50170f1f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:12.050969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-04ab1532-9b5a-4feb-b23c-793e50170f1f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:12.057995 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-04ab1532-9b5a-4feb-b23c-793e50170f1f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:12.058470 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-04ab1532-9b5a-4feb-b23c-793e50170f1f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:12.058906 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-04ab1532-9b5a-4feb-b23c-793e50170f1f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:12.059594 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-04ab1532-9b5a-4feb-b23c-793e50170f1f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:12.060080 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-04ab1532-9b5a-4feb-b23c-793e50170f1f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:12.060499 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-04ab1532-9b5a-4feb-b23c-793e50170f1f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:12.200592 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-04ab1532-9b5a-4feb-b23c-793e50170f1f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:12.210291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-04ab1532-9b5a-4feb-b23c-793e50170f1f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1724 microversion: 2.1 time: 0.164506 Aug 26 15:54:12.216069 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 240/477] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:12 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:13.041591 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e1932e6c-9d88-47ed-ae9f-13ab29641a54 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:13.042237 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e1932e6c-9d88-47ed-ae9f-13ab29641a54 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:13.049087 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e1932e6c-9d88-47ed-ae9f-13ab29641a54 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:13.049570 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e1932e6c-9d88-47ed-ae9f-13ab29641a54 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:13.050064 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e1932e6c-9d88-47ed-ae9f-13ab29641a54 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:13.050794 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e1932e6c-9d88-47ed-ae9f-13ab29641a54 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:13.051254 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e1932e6c-9d88-47ed-ae9f-13ab29641a54 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:13.051700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e1932e6c-9d88-47ed-ae9f-13ab29641a54 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:13.194151 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e1932e6c-9d88-47ed-ae9f-13ab29641a54 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:13.202814 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e1932e6c-9d88-47ed-ae9f-13ab29641a54 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.165055 Aug 26 15:54:13.203398 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 238/478] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:13 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:13.233208 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f5bca858-43c7-46d4-b8fd-991fb816a64b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:13.233977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f5bca858-43c7-46d4-b8fd-991fb816a64b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:13.241012 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f5bca858-43c7-46d4-b8fd-991fb816a64b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:13.241493 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f5bca858-43c7-46d4-b8fd-991fb816a64b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:13.241930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f5bca858-43c7-46d4-b8fd-991fb816a64b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:13.242636 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f5bca858-43c7-46d4-b8fd-991fb816a64b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:13.243092 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f5bca858-43c7-46d4-b8fd-991fb816a64b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:13.243518 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f5bca858-43c7-46d4-b8fd-991fb816a64b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:13.383837 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f5bca858-43c7-46d4-b8fd-991fb816a64b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:13.390104 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:13.393365 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f5bca858-43c7-46d4-b8fd-991fb816a64b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1724 microversion: 2.1 time: 0.164805 Aug 26 15:54:13.394527 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 241/479] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:13 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:14.227839 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-6e9c0046-a2a2-45e2-ae6c-1603567659b9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:14.228495 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-6e9c0046-a2a2-45e2-ae6c-1603567659b9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:14.235135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6e9c0046-a2a2-45e2-ae6c-1603567659b9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:14.235617 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6e9c0046-a2a2-45e2-ae6c-1603567659b9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:14.236084 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6e9c0046-a2a2-45e2-ae6c-1603567659b9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:14.236785 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6e9c0046-a2a2-45e2-ae6c-1603567659b9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:14.237236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6e9c0046-a2a2-45e2-ae6c-1603567659b9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:14.237655 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6e9c0046-a2a2-45e2-ae6c-1603567659b9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:14.377713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-6e9c0046-a2a2-45e2-ae6c-1603567659b9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:14.388140 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-6e9c0046-a2a2-45e2-ae6c-1603567659b9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.167365 Aug 26 15:54:14.388727 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 239/480] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:14 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:14.417300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c8aef8a7-fe65-4c23-bc12-1c4140a3d03e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:14.417941 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c8aef8a7-fe65-4c23-bc12-1c4140a3d03e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:14.425230 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c8aef8a7-fe65-4c23-bc12-1c4140a3d03e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:14.425719 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c8aef8a7-fe65-4c23-bc12-1c4140a3d03e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:14.426703 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c8aef8a7-fe65-4c23-bc12-1c4140a3d03e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:14.427406 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c8aef8a7-fe65-4c23-bc12-1c4140a3d03e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:14.427858 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c8aef8a7-fe65-4c23-bc12-1c4140a3d03e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:14.428318 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c8aef8a7-fe65-4c23-bc12-1c4140a3d03e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:14.578904 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c8aef8a7-fe65-4c23-bc12-1c4140a3d03e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:14.593282 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c8aef8a7-fe65-4c23-bc12-1c4140a3d03e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1724 microversion: 2.1 time: 0.179532 Aug 26 15:54:14.597777 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 242/481] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:14 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:15.408816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ed3dd7f7-2aac-4dac-bf6f-fe3287d1b197 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:15.410084 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ed3dd7f7-2aac-4dac-bf6f-fe3287d1b197 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:15.416493 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed3dd7f7-2aac-4dac-bf6f-fe3287d1b197 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:15.416975 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed3dd7f7-2aac-4dac-bf6f-fe3287d1b197 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:15.417410 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed3dd7f7-2aac-4dac-bf6f-fe3287d1b197 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:15.418098 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed3dd7f7-2aac-4dac-bf6f-fe3287d1b197 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:15.418552 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed3dd7f7-2aac-4dac-bf6f-fe3287d1b197 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:15.418978 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed3dd7f7-2aac-4dac-bf6f-fe3287d1b197 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:15.553975 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ed3dd7f7-2aac-4dac-bf6f-fe3287d1b197 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:15.562282 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ed3dd7f7-2aac-4dac-bf6f-fe3287d1b197 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.157185 Aug 26 15:54:15.562843 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 240/482] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:15 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:15.616707 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7fa0cf30-6cf4-4922-b6af-4ff319beb6bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:15.624399 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7fa0cf30-6cf4-4922-b6af-4ff319beb6bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:15.624399 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fa0cf30-6cf4-4922-b6af-4ff319beb6bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:15.624710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fa0cf30-6cf4-4922-b6af-4ff319beb6bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:15.625138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fa0cf30-6cf4-4922-b6af-4ff319beb6bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:15.625825 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fa0cf30-6cf4-4922-b6af-4ff319beb6bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:15.626264 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fa0cf30-6cf4-4922-b6af-4ff319beb6bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:15.626679 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fa0cf30-6cf4-4922-b6af-4ff319beb6bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:15.773199 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7fa0cf30-6cf4-4922-b6af-4ff319beb6bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:15.782791 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7fa0cf30-6cf4-4922-b6af-4ff319beb6bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1724 microversion: 2.1 time: 0.169881 Aug 26 15:54:15.784066 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 243/483] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:15 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:16.589395 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7ad7dfc2-50d6-4885-8b7d-a7b25ff18147 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:16.590012 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7ad7dfc2-50d6-4885-8b7d-a7b25ff18147 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:16.597816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ad7dfc2-50d6-4885-8b7d-a7b25ff18147 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:16.598642 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ad7dfc2-50d6-4885-8b7d-a7b25ff18147 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:16.599302 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ad7dfc2-50d6-4885-8b7d-a7b25ff18147 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:16.600258 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ad7dfc2-50d6-4885-8b7d-a7b25ff18147 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:16.601036 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ad7dfc2-50d6-4885-8b7d-a7b25ff18147 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:16.601609 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ad7dfc2-50d6-4885-8b7d-a7b25ff18147 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:16.736433 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7ad7dfc2-50d6-4885-8b7d-a7b25ff18147 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:16.744944 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7ad7dfc2-50d6-4885-8b7d-a7b25ff18147 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.164216 Aug 26 15:54:16.747908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 241/484] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:16 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:16.806723 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-3c5f33f8-a3b0-459b-be70-bbd89125658c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:16.807432 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-3c5f33f8-a3b0-459b-be70-bbd89125658c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:16.814404 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3c5f33f8-a3b0-459b-be70-bbd89125658c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:16.815205 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3c5f33f8-a3b0-459b-be70-bbd89125658c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:16.815786 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3c5f33f8-a3b0-459b-be70-bbd89125658c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:16.817118 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3c5f33f8-a3b0-459b-be70-bbd89125658c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:16.817570 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3c5f33f8-a3b0-459b-be70-bbd89125658c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:16.818062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3c5f33f8-a3b0-459b-be70-bbd89125658c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:16.964852 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-3c5f33f8-a3b0-459b-be70-bbd89125658c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:16.974387 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-3c5f33f8-a3b0-459b-be70-bbd89125658c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1724 microversion: 2.1 time: 0.171542 Aug 26 15:54:16.975551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 244/485] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:16 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:17.766276 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d47108f4-967e-4f94-aa24-631d1c33bbc7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:17.766841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d47108f4-967e-4f94-aa24-631d1c33bbc7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:17.773850 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d47108f4-967e-4f94-aa24-631d1c33bbc7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:17.774327 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d47108f4-967e-4f94-aa24-631d1c33bbc7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:17.774764 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d47108f4-967e-4f94-aa24-631d1c33bbc7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:17.775450 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d47108f4-967e-4f94-aa24-631d1c33bbc7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:17.775922 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d47108f4-967e-4f94-aa24-631d1c33bbc7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:17.776347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d47108f4-967e-4f94-aa24-631d1c33bbc7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:17.908641 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d47108f4-967e-4f94-aa24-631d1c33bbc7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:17.916233 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d47108f4-967e-4f94-aa24-631d1c33bbc7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.153890 Aug 26 15:54:17.916801 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 242/486] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:17 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:17.996765 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7a5fa865-8ed6-4d1f-b780-ee9349c5418c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:17.997387 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7a5fa865-8ed6-4d1f-b780-ee9349c5418c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:18.003926 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a5fa865-8ed6-4d1f-b780-ee9349c5418c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:18.004406 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a5fa865-8ed6-4d1f-b780-ee9349c5418c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:18.004839 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a5fa865-8ed6-4d1f-b780-ee9349c5418c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:18.005526 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a5fa865-8ed6-4d1f-b780-ee9349c5418c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:18.005971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a5fa865-8ed6-4d1f-b780-ee9349c5418c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:18.006397 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a5fa865-8ed6-4d1f-b780-ee9349c5418c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:18.137654 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7a5fa865-8ed6-4d1f-b780-ee9349c5418c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:18.145983 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7a5fa865-8ed6-4d1f-b780-ee9349c5418c tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1724 microversion: 2.1 time: 0.153097 Aug 26 15:54:18.146546 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 245/487] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:17 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:18.937221 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c765ff8f-5b0e-4bbe-94cc-5a62bf6fb5cf tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:18.937884 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c765ff8f-5b0e-4bbe-94cc-5a62bf6fb5cf tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:18.945102 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c765ff8f-5b0e-4bbe-94cc-5a62bf6fb5cf tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:18.945589 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c765ff8f-5b0e-4bbe-94cc-5a62bf6fb5cf tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:18.946030 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c765ff8f-5b0e-4bbe-94cc-5a62bf6fb5cf tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:18.946725 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c765ff8f-5b0e-4bbe-94cc-5a62bf6fb5cf tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:18.947176 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c765ff8f-5b0e-4bbe-94cc-5a62bf6fb5cf tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:18.947600 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c765ff8f-5b0e-4bbe-94cc-5a62bf6fb5cf tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:18.951972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:18.983907 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-3e612d94-ff54-4ae3-85d4-182891cf36a0 req-d1bb7d5e-d23c-4257-bef9-ebd05227c02b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe4d635-4211-49a0-99c5-aa69824b0de6", "tag": "c3463a69-702b-4594-8fcf-701aaf1b3696"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:18.994005 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-3e612d94-ff54-4ae3-85d4-182891cf36a0 req-d1bb7d5e-d23c-4257-bef9-ebd05227c02b service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:18.994616 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-3e612d94-ff54-4ae3-85d4-182891cf36a0 req-d1bb7d5e-d23c-4257-bef9-ebd05227c02b service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:18.995113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-3e612d94-ff54-4ae3-85d4-182891cf36a0 req-d1bb7d5e-d23c-4257-bef9-ebd05227c02b service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:19.006950 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-3e612d94-ff54-4ae3-85d4-182891cf36a0 req-d1bb7d5e-d23c-4257-bef9-ebd05227c02b service nova] Creating event network-changed:c3463a69-702b-4594-8fcf-701aaf1b3696 for instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 on hv-cinder-83124 Aug 26 15:54:19.013834 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-3e612d94-ff54-4ae3-85d4-182891cf36a0 req-d1bb7d5e-d23c-4257-bef9-ebd05227c02b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033546 Aug 26 15:54:19.014545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 246/488] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:54:19.129904 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c765ff8f-5b0e-4bbe-94cc-5a62bf6fb5cf tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:19.137938 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c765ff8f-5b0e-4bbe-94cc-5a62bf6fb5cf tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.204644 Aug 26 15:54:19.138528 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 243/489] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:18 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:19.171417 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1a7b0b0e-657f-4359-b1b7-04cd119b4f8a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:19.172340 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1a7b0b0e-657f-4359-b1b7-04cd119b4f8a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:19.179208 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1a7b0b0e-657f-4359-b1b7-04cd119b4f8a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:19.179707 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1a7b0b0e-657f-4359-b1b7-04cd119b4f8a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:19.180190 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1a7b0b0e-657f-4359-b1b7-04cd119b4f8a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:19.180922 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1a7b0b0e-657f-4359-b1b7-04cd119b4f8a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:19.181390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1a7b0b0e-657f-4359-b1b7-04cd119b4f8a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:19.181821 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1a7b0b0e-657f-4359-b1b7-04cd119b4f8a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:19.314823 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1a7b0b0e-657f-4359-b1b7-04cd119b4f8a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:19.323492 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1a7b0b0e-657f-4359-b1b7-04cd119b4f8a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1724 microversion: 2.1 time: 0.159009 Aug 26 15:54:19.324095 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 247/490] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:19 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:20.159491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5b926f4f-b0a1-47fc-bc4a-62a76c8d9689 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:20.160155 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5b926f4f-b0a1-47fc-bc4a-62a76c8d9689 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:20.162481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:20.167112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b926f4f-b0a1-47fc-bc4a-62a76c8d9689 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:20.167596 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b926f4f-b0a1-47fc-bc4a-62a76c8d9689 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:20.168062 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b926f4f-b0a1-47fc-bc4a-62a76c8d9689 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:20.168752 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b926f4f-b0a1-47fc-bc4a-62a76c8d9689 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:20.169203 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b926f4f-b0a1-47fc-bc4a-62a76c8d9689 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:20.169629 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b926f4f-b0a1-47fc-bc4a-62a76c8d9689 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:20.308450 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-5b926f4f-b0a1-47fc-bc4a-62a76c8d9689 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:20.316772 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5b926f4f-b0a1-47fc-bc4a-62a76c8d9689 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.161167 Aug 26 15:54:20.317336 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 244/491] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:20 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:20.345123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-8f1d8956-9929-4c97-8b49-a3c4a5875df7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:20.345713 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-8f1d8956-9929-4c97-8b49-a3c4a5875df7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:20.352276 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8f1d8956-9929-4c97-8b49-a3c4a5875df7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:20.352759 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8f1d8956-9929-4c97-8b49-a3c4a5875df7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:20.353193 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8f1d8956-9929-4c97-8b49-a3c4a5875df7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:20.353891 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8f1d8956-9929-4c97-8b49-a3c4a5875df7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:20.354341 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8f1d8956-9929-4c97-8b49-a3c4a5875df7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:20.354765 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8f1d8956-9929-4c97-8b49-a3c4a5875df7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:20.489706 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-8f1d8956-9929-4c97-8b49-a3c4a5875df7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:20.498185 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-8f1d8956-9929-4c97-8b49-a3c4a5875df7 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1724 microversion: 2.1 time: 0.156816 Aug 26 15:54:20.498770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 248/492] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:20 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:21.339225 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4eed0f99-32b5-45e5-a2d6-3b5185c08576 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:21.339963 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-4eed0f99-32b5-45e5-a2d6-3b5185c08576 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:21.348194 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4eed0f99-32b5-45e5-a2d6-3b5185c08576 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:21.348793 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4eed0f99-32b5-45e5-a2d6-3b5185c08576 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:21.349306 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4eed0f99-32b5-45e5-a2d6-3b5185c08576 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:21.350107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4eed0f99-32b5-45e5-a2d6-3b5185c08576 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:21.350636 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4eed0f99-32b5-45e5-a2d6-3b5185c08576 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:21.351133 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4eed0f99-32b5-45e5-a2d6-3b5185c08576 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:21.504356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4eed0f99-32b5-45e5-a2d6-3b5185c08576 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:21.512497 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4eed0f99-32b5-45e5-a2d6-3b5185c08576 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.177552 Aug 26 15:54:21.512979 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 245/493] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:21 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:21.520276 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-323d7534-a11e-4354-9296-9ff9a43d48f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:21.520913 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-323d7534-a11e-4354-9296-9ff9a43d48f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:21.527740 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-323d7534-a11e-4354-9296-9ff9a43d48f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:21.528500 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-323d7534-a11e-4354-9296-9ff9a43d48f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:21.529243 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-323d7534-a11e-4354-9296-9ff9a43d48f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:21.529943 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-323d7534-a11e-4354-9296-9ff9a43d48f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:21.530392 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-323d7534-a11e-4354-9296-9ff9a43d48f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:21.530813 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-323d7534-a11e-4354-9296-9ff9a43d48f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:21.666182 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-323d7534-a11e-4354-9296-9ff9a43d48f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:21.674376 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-323d7534-a11e-4354-9296-9ff9a43d48f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1730 microversion: 2.1 time: 0.158661 Aug 26 15:54:21.674948 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 249/494] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:21 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:21.696320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-88350ead-d6ad-46b2-959f-9955730c3731 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:21.696739 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-88350ead-d6ad-46b2-959f-9955730c3731 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:21.702970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-88350ead-d6ad-46b2-959f-9955730c3731 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:21.703457 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-88350ead-d6ad-46b2-959f-9955730c3731 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:21.703950 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-88350ead-d6ad-46b2-959f-9955730c3731 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:21.704664 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-88350ead-d6ad-46b2-959f-9955730c3731 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:21.705119 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-88350ead-d6ad-46b2-959f-9955730c3731 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:21.705549 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-88350ead-d6ad-46b2-959f-9955730c3731 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:21.783618 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-88350ead-d6ad-46b2-959f-9955730c3731 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092543 Aug 26 15:54:21.784253 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 246/495] 10.222.0.98 () {58 vars in 1275 bytes} [Fri Aug 26 15:54:21 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:22.534085 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e20f1114-e113-47cb-9e57-0f78c8bb8723 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:22.535344 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e20f1114-e113-47cb-9e57-0f78c8bb8723 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:22.542554 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e20f1114-e113-47cb-9e57-0f78c8bb8723 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:22.543158 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e20f1114-e113-47cb-9e57-0f78c8bb8723 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:22.543664 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e20f1114-e113-47cb-9e57-0f78c8bb8723 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:22.544503 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e20f1114-e113-47cb-9e57-0f78c8bb8723 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:22.545060 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e20f1114-e113-47cb-9e57-0f78c8bb8723 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:22.545556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e20f1114-e113-47cb-9e57-0f78c8bb8723 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:22.849349 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e20f1114-e113-47cb-9e57-0f78c8bb8723 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:22.857147 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e20f1114-e113-47cb-9e57-0f78c8bb8723 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.327223 Aug 26 15:54:22.857709 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 250/496] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:22 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:23.377318 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-beb8baec-4147-4e4e-bde8-078d1c289c89 req-456e0d2a-43e9-4739-b5d1-60a84f7cd696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d976c8-85c3-48de-80ba-93fdff79445a", "tag": "c5172524-b071-4da7-93f1-8465faf155b2"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:23.388709 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-beb8baec-4147-4e4e-bde8-078d1c289c89 req-456e0d2a-43e9-4739-b5d1-60a84f7cd696 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:23.389186 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-beb8baec-4147-4e4e-bde8-078d1c289c89 req-456e0d2a-43e9-4739-b5d1-60a84f7cd696 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:23.389819 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-beb8baec-4147-4e4e-bde8-078d1c289c89 req-456e0d2a-43e9-4739-b5d1-60a84f7cd696 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:23.402351 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-beb8baec-4147-4e4e-bde8-078d1c289c89 req-456e0d2a-43e9-4739-b5d1-60a84f7cd696 service nova] Creating event network-changed:c5172524-b071-4da7-93f1-8465faf155b2 for instance 08d976c8-85c3-48de-80ba-93fdff79445a on hv-cinder-83124 Aug 26 15:54:23.407603 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-beb8baec-4147-4e4e-bde8-078d1c289c89 req-456e0d2a-43e9-4739-b5d1-60a84f7cd696 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034368 Aug 26 15:54:23.408257 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 247/497] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:23.487056 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-2bf7ac8f-43e2-45e4-aaf8-599fbfea8b8b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:23.488408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-2bf7ac8f-43e2-45e4-aaf8-599fbfea8b8b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:23.495278 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bf7ac8f-43e2-45e4-aaf8-599fbfea8b8b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:23.496335 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bf7ac8f-43e2-45e4-aaf8-599fbfea8b8b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:23.496878 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bf7ac8f-43e2-45e4-aaf8-599fbfea8b8b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:23.497670 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bf7ac8f-43e2-45e4-aaf8-599fbfea8b8b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:23.498212 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bf7ac8f-43e2-45e4-aaf8-599fbfea8b8b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:23.498714 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bf7ac8f-43e2-45e4-aaf8-599fbfea8b8b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:23.538220 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-2bf7ac8f-43e2-45e4-aaf8-599fbfea8b8b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Going to try to terminate instance {{(pid=127697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:54:23.879237 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3821de35-ac60-47a3-a6bf-ec5a36967a0e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:23.880019 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3821de35-ac60-47a3-a6bf-ec5a36967a0e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:23.886209 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3821de35-ac60-47a3-a6bf-ec5a36967a0e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:23.886688 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3821de35-ac60-47a3-a6bf-ec5a36967a0e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:23.887149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3821de35-ac60-47a3-a6bf-ec5a36967a0e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:23.887833 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3821de35-ac60-47a3-a6bf-ec5a36967a0e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:23.888317 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3821de35-ac60-47a3-a6bf-ec5a36967a0e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:23.888736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3821de35-ac60-47a3-a6bf-ec5a36967a0e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:23.895130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-2bf7ac8f-43e2-45e4-aaf8-599fbfea8b8b tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "DELETE /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 204 len: 0 microversion: 2.1 time: 0.409667 Aug 26 15:54:23.899712 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 251/498] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:54:23 2022] DELETE /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:54:23.905343 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-88d61514-cc83-4111-93a9-ddf928e0e37f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:23.906063 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-88d61514-cc83-4111-93a9-ddf928e0e37f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:23.912573 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-88d61514-cc83-4111-93a9-ddf928e0e37f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:23.913433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-88d61514-cc83-4111-93a9-ddf928e0e37f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:23.913828 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-88d61514-cc83-4111-93a9-ddf928e0e37f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:23.914587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-88d61514-cc83-4111-93a9-ddf928e0e37f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:23.915228 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-88d61514-cc83-4111-93a9-ddf928e0e37f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:23.915654 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-88d61514-cc83-4111-93a9-ddf928e0e37f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:24.038473 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3821de35-ac60-47a3-a6bf-ec5a36967a0e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:24.046685 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3821de35-ac60-47a3-a6bf-ec5a36967a0e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.172215 Aug 26 15:54:24.047564 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 248/499] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:23 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:24.069771 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-88d61514-cc83-4111-93a9-ddf928e0e37f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:24.077999 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-88d61514-cc83-4111-93a9-ddf928e0e37f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1514 microversion: 2.1 time: 0.176877 Aug 26 15:54:24.078600 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 252/500] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:23 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:25.070881 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1cfd60ab-0524-4ce5-a1a8-2930c893abf5 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:25.071543 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-1cfd60ab-0524-4ce5-a1a8-2930c893abf5 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:25.078247 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1cfd60ab-0524-4ce5-a1a8-2930c893abf5 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:25.078741 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1cfd60ab-0524-4ce5-a1a8-2930c893abf5 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:25.079180 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1cfd60ab-0524-4ce5-a1a8-2930c893abf5 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:25.079933 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1cfd60ab-0524-4ce5-a1a8-2930c893abf5 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:25.080388 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1cfd60ab-0524-4ce5-a1a8-2930c893abf5 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:25.080815 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1cfd60ab-0524-4ce5-a1a8-2930c893abf5 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:25.099520 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c7e85c29-86dc-4a49-a28f-4ca785ca2d28 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:25.100853 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c7e85c29-86dc-4a49-a28f-4ca785ca2d28 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:25.107857 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7e85c29-86dc-4a49-a28f-4ca785ca2d28 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:25.111700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7e85c29-86dc-4a49-a28f-4ca785ca2d28 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:25.111700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7e85c29-86dc-4a49-a28f-4ca785ca2d28 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:25.111700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7e85c29-86dc-4a49-a28f-4ca785ca2d28 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:25.111700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7e85c29-86dc-4a49-a28f-4ca785ca2d28 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:25.112095 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c7e85c29-86dc-4a49-a28f-4ca785ca2d28 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:25.246934 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c7e85c29-86dc-4a49-a28f-4ca785ca2d28 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:25.254939 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c7e85c29-86dc-4a49-a28f-4ca785ca2d28 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1514 microversion: 2.1 time: 0.159830 Aug 26 15:54:25.255522 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 253/501] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:25 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:54:25.260980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1cfd60ab-0524-4ce5-a1a8-2930c893abf5 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:25.269437 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-1cfd60ab-0524-4ce5-a1a8-2930c893abf5 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.203861 Aug 26 15:54:25.270013 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 249/502] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:25 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:25.425608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-d58c6d92-e0a8-4544-905c-b6f2b7e7c7fb req-d8db39f7-8c45-4ed8-ba42-91f54e993133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d976c8-85c3-48de-80ba-93fdff79445a", "tag": "c5172524-b071-4da7-93f1-8465faf155b2"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:25.434880 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-d58c6d92-e0a8-4544-905c-b6f2b7e7c7fb req-d8db39f7-8c45-4ed8-ba42-91f54e993133 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:25.435348 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-d58c6d92-e0a8-4544-905c-b6f2b7e7c7fb req-d8db39f7-8c45-4ed8-ba42-91f54e993133 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:25.435779 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-d58c6d92-e0a8-4544-905c-b6f2b7e7c7fb req-d8db39f7-8c45-4ed8-ba42-91f54e993133 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:25.447204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-d58c6d92-e0a8-4544-905c-b6f2b7e7c7fb req-d8db39f7-8c45-4ed8-ba42-91f54e993133 service nova] Creating event network-changed:c5172524-b071-4da7-93f1-8465faf155b2 for instance 08d976c8-85c3-48de-80ba-93fdff79445a on hv-cinder-83124 Aug 26 15:54:25.452308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-d58c6d92-e0a8-4544-905c-b6f2b7e7c7fb req-d8db39f7-8c45-4ed8-ba42-91f54e993133 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030397 Aug 26 15:54:25.452888 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 254/503] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:26.275009 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f3d6edf7-d12d-4b50-93e2-cb88556607b9 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:26.275613 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f3d6edf7-d12d-4b50-93e2-cb88556607b9 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:26.282031 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f3d6edf7-d12d-4b50-93e2-cb88556607b9 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:26.282510 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f3d6edf7-d12d-4b50-93e2-cb88556607b9 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:26.282936 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f3d6edf7-d12d-4b50-93e2-cb88556607b9 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:26.283647 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f3d6edf7-d12d-4b50-93e2-cb88556607b9 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:26.284122 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f3d6edf7-d12d-4b50-93e2-cb88556607b9 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:26.285049 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f3d6edf7-d12d-4b50-93e2-cb88556607b9 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:26.291583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d1286ecb-e06f-48cf-b2dc-27aaeda9f5cb tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:26.292313 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d1286ecb-e06f-48cf-b2dc-27aaeda9f5cb tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:26.298793 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d1286ecb-e06f-48cf-b2dc-27aaeda9f5cb tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:26.299281 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d1286ecb-e06f-48cf-b2dc-27aaeda9f5cb tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:26.299718 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d1286ecb-e06f-48cf-b2dc-27aaeda9f5cb tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:26.301076 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d1286ecb-e06f-48cf-b2dc-27aaeda9f5cb tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:26.301552 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d1286ecb-e06f-48cf-b2dc-27aaeda9f5cb tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:26.301984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d1286ecb-e06f-48cf-b2dc-27aaeda9f5cb tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:26.417633 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f3d6edf7-d12d-4b50-93e2-cb88556607b9 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:26.427026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f3d6edf7-d12d-4b50-93e2-cb88556607b9 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1514 microversion: 2.1 time: 0.155833 Aug 26 15:54:26.427616 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 250/504] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:26 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:26.437306 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d1286ecb-e06f-48cf-b2dc-27aaeda9f5cb tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:26.448076 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d1286ecb-e06f-48cf-b2dc-27aaeda9f5cb tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.161068 Aug 26 15:54:26.448659 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 255/505] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:26 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:54:27.448533 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-cb488c27-b2c3-4ca2-9428-42be8e6bd161 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:27.449160 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-cb488c27-b2c3-4ca2-9428-42be8e6bd161 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:27.455777 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb488c27-b2c3-4ca2-9428-42be8e6bd161 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:27.456336 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb488c27-b2c3-4ca2-9428-42be8e6bd161 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:27.456834 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb488c27-b2c3-4ca2-9428-42be8e6bd161 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:27.457523 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb488c27-b2c3-4ca2-9428-42be8e6bd161 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:27.457962 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb488c27-b2c3-4ca2-9428-42be8e6bd161 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:27.458382 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb488c27-b2c3-4ca2-9428-42be8e6bd161 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:27.472180 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d4509c43-6aac-48f8-92ed-275c756b1ac9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:27.472898 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d4509c43-6aac-48f8-92ed-275c756b1ac9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:27.479513 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d4509c43-6aac-48f8-92ed-275c756b1ac9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:27.480040 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d4509c43-6aac-48f8-92ed-275c756b1ac9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:27.480480 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d4509c43-6aac-48f8-92ed-275c756b1ac9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:27.481199 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d4509c43-6aac-48f8-92ed-275c756b1ac9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:27.481663 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d4509c43-6aac-48f8-92ed-275c756b1ac9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:27.482084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d4509c43-6aac-48f8-92ed-275c756b1ac9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:27.662755 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-cb488c27-b2c3-4ca2-9428-42be8e6bd161 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:27.671258 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-cb488c27-b2c3-4ca2-9428-42be8e6bd161 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1514 microversion: 2.1 time: 0.226912 Aug 26 15:54:27.682495 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d4509c43-6aac-48f8-92ed-275c756b1ac9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:27.685941 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 251/506] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:27 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:27.690501 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d4509c43-6aac-48f8-92ed-275c756b1ac9 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.221994 Aug 26 15:54:27.692547 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 256/507] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:27 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:54:28.244998 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-2539b1ce-81f4-4bd5-a553-072a4c0167f3 req-bb7a8a06-86b0-44ca-ad20-c942252885e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33", "name": "network-vif-deleted", "tag": "52d33e41-9211-4ad4-ac40-766f6c12c9d8"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:28.255266 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-2539b1ce-81f4-4bd5-a553-072a4c0167f3 req-bb7a8a06-86b0-44ca-ad20-c942252885e7 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:28.255744 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-2539b1ce-81f4-4bd5-a553-072a4c0167f3 req-bb7a8a06-86b0-44ca-ad20-c942252885e7 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:28.256228 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-2539b1ce-81f4-4bd5-a553-072a4c0167f3 req-bb7a8a06-86b0-44ca-ad20-c942252885e7 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:28.270875 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-2539b1ce-81f4-4bd5-a553-072a4c0167f3 req-bb7a8a06-86b0-44ca-ad20-c942252885e7 service nova] Creating event network-vif-deleted:52d33e41-9211-4ad4-ac40-766f6c12c9d8 for instance ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 on hv-cinder-83124 Aug 26 15:54:28.276213 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-2539b1ce-81f4-4bd5-a553-072a4c0167f3 req-bb7a8a06-86b0-44ca-ad20-c942252885e7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034776 Aug 26 15:54:28.277217 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 252/508] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:28.692841 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f9017002-bd1e-4f5b-a202-1ae1f3bba376 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:28.693593 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f9017002-bd1e-4f5b-a202-1ae1f3bba376 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:28.700350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f9017002-bd1e-4f5b-a202-1ae1f3bba376 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:28.700827 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f9017002-bd1e-4f5b-a202-1ae1f3bba376 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:28.701252 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f9017002-bd1e-4f5b-a202-1ae1f3bba376 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:28.701944 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f9017002-bd1e-4f5b-a202-1ae1f3bba376 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:28.702437 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f9017002-bd1e-4f5b-a202-1ae1f3bba376 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:28.702848 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f9017002-bd1e-4f5b-a202-1ae1f3bba376 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:28.719242 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-89a58e5e-0597-4c48-abaa-52c8f680eb21 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:28.719989 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-89a58e5e-0597-4c48-abaa-52c8f680eb21 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:28.727302 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89a58e5e-0597-4c48-abaa-52c8f680eb21 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:28.728073 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89a58e5e-0597-4c48-abaa-52c8f680eb21 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:28.728496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89a58e5e-0597-4c48-abaa-52c8f680eb21 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:28.729183 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89a58e5e-0597-4c48-abaa-52c8f680eb21 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:28.729624 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89a58e5e-0597-4c48-abaa-52c8f680eb21 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:28.730045 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89a58e5e-0597-4c48-abaa-52c8f680eb21 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:28.736259 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f9017002-bd1e-4f5b-a202-1ae1f3bba376 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:28.736745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f9017002-bd1e-4f5b-a202-1ae1f3bba376 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:28.737179 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f9017002-bd1e-4f5b-a202-1ae1f3bba376 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:28.743094 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-f9017002-bd1e-4f5b-a202-1ae1f3bba376 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lazy-loading 'fault' on Instance uuid ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:54:28.792861 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f9017002-bd1e-4f5b-a202-1ae1f3bba376 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:28.796803 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:28.801945 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f9017002-bd1e-4f5b-a202-1ae1f3bba376 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 200 len: 1309 microversion: 2.1 time: 0.112962 Aug 26 15:54:28.802542 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 257/509] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:28 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:28.883425 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-89a58e5e-0597-4c48-abaa-52c8f680eb21 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:28.891118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-89a58e5e-0597-4c48-abaa-52c8f680eb21 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.175948 Aug 26 15:54:28.891723 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 253/510] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:28 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:54:29.824769 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6b4f85aa-ea62-4c3d-b61a-8cfb274a1874 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:29.825369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6b4f85aa-ea62-4c3d-b61a-8cfb274a1874 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:29.834491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b4f85aa-ea62-4c3d-b61a-8cfb274a1874 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:29.834981 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b4f85aa-ea62-4c3d-b61a-8cfb274a1874 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:29.835421 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b4f85aa-ea62-4c3d-b61a-8cfb274a1874 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:29.836191 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b4f85aa-ea62-4c3d-b61a-8cfb274a1874 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:29.836652 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b4f85aa-ea62-4c3d-b61a-8cfb274a1874 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:29.837130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6b4f85aa-ea62-4c3d-b61a-8cfb274a1874 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:29.853217 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-6b4f85aa-ea62-4c3d-b61a-8cfb274a1874 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] HTTP exception thrown: Instance ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 could not be found. Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6b4f85aa-ea62-4c3d-b61a-8cfb274a1874 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Request method failure captured: Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 HTTP/1.1 Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOxFhDLMK6khBXGytfsH69lwb8FhxEZ_E3mnHJHG8QgW-MnA-CFf89yVmKt9srw6BLTgMFMVZEU4QU48flVsPM_j0A9qlrjpaklfLGKocO5g109aEiNKRN-tLwDJIzBFDLtGRsk9Me3Q6KcWDc19cVJkKmBJSRVlLaij2ISS32-oK-s Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: 7e4bab21dc3141bd89ee2ea54fe0c14c Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-VolumesSnapshotTestJSON-447155880 Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:54:29.854832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:54:29.856685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/7e4bab21dc3141bd89ee2ea54fe0c14c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_7e4bab21dc3141bd89ee2ea54fe0c14c", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7e4bab21dc3141bd89ee2ea54fe0c14c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7e4bab21dc3141bd89ee2ea54fe0c14c"}]}] Aug 26 15:54:29.856685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-VolumesSnapshotTestJSON-447155880 Aug 26 15:54:29.856685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: 7e4bab21dc3141bd89ee2ea54fe0c14c Aug 26 15:54:29.856685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-447155880 Aug 26 15:54:29.856685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-VolumesSnapshotTestJSON-447155880-project Aug 26 15:54:29.856685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:54:29.856685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:54:29.856685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 28436612400e421ca52f902542186a68 Aug 26 15:54:29.856685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-VolumesSnapshotTestJSON-447155880-project Aug 26 15:54:29.856685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:54:29.856685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 could not be found. Aug 26 15:54:29.856685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': 'ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33'} Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 could not be found. Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:54:29.857638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 could not be found. Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 could not be found. Aug 26 15:54:29.859169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:54:29.867376 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6b4f85aa-ea62-4c3d-b61a-8cfb274a1874 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Returning 404 to user: Instance ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:54:29.867376 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6b4f85aa-ea62-4c3d-b61a-8cfb274a1874 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33" status: 404 len: 111 microversion: 2.1 time: 0.035784 Aug 26 15:54:29.867376 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 258/511] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:29 2022] GET /compute/v2.1/servers/ae3d0d8c-aaa6-4e9c-9a70-b1a6481f9e33 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:54:29.889569 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-0d4fc164-844f-4ad4-910d-df654ba99f3c req-d194d005-762d-4329-b4ff-a583da64f67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe4d635-4211-49a0-99c5-aa69824b0de6", "name": "network-vif-plugged", "status": "completed", "tag": "c3463a69-702b-4594-8fcf-701aaf1b3696"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:29.900987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-0d4fc164-844f-4ad4-910d-df654ba99f3c req-d194d005-762d-4329-b4ff-a583da64f67f service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:29.901569 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-0d4fc164-844f-4ad4-910d-df654ba99f3c req-d194d005-762d-4329-b4ff-a583da64f67f service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:29.902760 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-0d4fc164-844f-4ad4-910d-df654ba99f3c req-d194d005-762d-4329-b4ff-a583da64f67f service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:29.913234 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-962cc85b-3d2b-4c75-a017-87d4cbb68813 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:29.918113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-962cc85b-3d2b-4c75-a017-87d4cbb68813 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:29.920463 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-0d4fc164-844f-4ad4-910d-df654ba99f3c req-d194d005-762d-4329-b4ff-a583da64f67f service nova] Creating event network-vif-plugged:c3463a69-702b-4594-8fcf-701aaf1b3696 for instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 on hv-cinder-83124 Aug 26 15:54:29.922539 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-962cc85b-3d2b-4c75-a017-87d4cbb68813 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:29.923087 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-962cc85b-3d2b-4c75-a017-87d4cbb68813 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:29.923602 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-962cc85b-3d2b-4c75-a017-87d4cbb68813 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:29.924423 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-962cc85b-3d2b-4c75-a017-87d4cbb68813 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:29.924950 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-962cc85b-3d2b-4c75-a017-87d4cbb68813 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:29.925447 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-962cc85b-3d2b-4c75-a017-87d4cbb68813 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:29.925719 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-0d4fc164-844f-4ad4-910d-df654ba99f3c req-d194d005-762d-4329-b4ff-a583da64f67f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046918 Aug 26 15:54:29.928039 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 254/512] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:30.083675 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-962cc85b-3d2b-4c75-a017-87d4cbb68813 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:30.091533 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-962cc85b-3d2b-4c75-a017-87d4cbb68813 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.182273 Aug 26 15:54:30.092262 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 259/513] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:29 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:54:31.113407 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-780685bc-8417-4f99-a1e4-92889b7c8d53 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:31.114514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-780685bc-8417-4f99-a1e4-92889b7c8d53 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:31.120629 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-780685bc-8417-4f99-a1e4-92889b7c8d53 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:31.121147 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-780685bc-8417-4f99-a1e4-92889b7c8d53 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:31.121582 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-780685bc-8417-4f99-a1e4-92889b7c8d53 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:31.122264 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-780685bc-8417-4f99-a1e4-92889b7c8d53 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:31.122713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-780685bc-8417-4f99-a1e4-92889b7c8d53 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:31.123164 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-780685bc-8417-4f99-a1e4-92889b7c8d53 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:31.254638 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-780685bc-8417-4f99-a1e4-92889b7c8d53 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:31.262329 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-780685bc-8417-4f99-a1e4-92889b7c8d53 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.153595 Aug 26 15:54:31.262888 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 255/514] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:31 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:32.283957 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-4664c9d5-145e-4285-aeb6-8843de878538 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:32.285076 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-4664c9d5-145e-4285-aeb6-8843de878538 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:32.287425 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:32.292151 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4664c9d5-145e-4285-aeb6-8843de878538 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:32.292635 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4664c9d5-145e-4285-aeb6-8843de878538 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:32.293072 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4664c9d5-145e-4285-aeb6-8843de878538 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:32.293770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4664c9d5-145e-4285-aeb6-8843de878538 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:32.294223 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4664c9d5-145e-4285-aeb6-8843de878538 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:32.294654 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4664c9d5-145e-4285-aeb6-8843de878538 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:32.430895 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-4664c9d5-145e-4285-aeb6-8843de878538 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:32.438808 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-4664c9d5-145e-4285-aeb6-8843de878538 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.158793 Aug 26 15:54:32.439369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 260/515] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:32 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:33.459001 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1ecc7c44-97c2-4db3-8188-254f9688b7f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:33.459629 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-1ecc7c44-97c2-4db3-8188-254f9688b7f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:33.466357 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1ecc7c44-97c2-4db3-8188-254f9688b7f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:33.466834 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1ecc7c44-97c2-4db3-8188-254f9688b7f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:33.467266 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1ecc7c44-97c2-4db3-8188-254f9688b7f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:33.468064 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1ecc7c44-97c2-4db3-8188-254f9688b7f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:33.468530 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1ecc7c44-97c2-4db3-8188-254f9688b7f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:33.468949 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1ecc7c44-97c2-4db3-8188-254f9688b7f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:33.604963 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1ecc7c44-97c2-4db3-8188-254f9688b7f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:33.613974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-1ecc7c44-97c2-4db3-8188-254f9688b7f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.158764 Aug 26 15:54:33.614563 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 256/516] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:33 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:34.634711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c1957ef5-19f4-454e-b247-e5624a6ff867 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:34.635350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c1957ef5-19f4-454e-b247-e5624a6ff867 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:34.641860 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c1957ef5-19f4-454e-b247-e5624a6ff867 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:34.642333 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c1957ef5-19f4-454e-b247-e5624a6ff867 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:34.642762 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c1957ef5-19f4-454e-b247-e5624a6ff867 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:34.643438 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c1957ef5-19f4-454e-b247-e5624a6ff867 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:34.643931 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c1957ef5-19f4-454e-b247-e5624a6ff867 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:34.644345 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c1957ef5-19f4-454e-b247-e5624a6ff867 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:34.779260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c1957ef5-19f4-454e-b247-e5624a6ff867 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:34.787813 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c1957ef5-19f4-454e-b247-e5624a6ff867 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1358 microversion: 2.1 time: 0.157034 Aug 26 15:54:34.788450 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 261/517] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:34 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:35.809148 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7cfabdea-311e-4bfd-9d9c-bca8c5d11e79 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:35.809681 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7cfabdea-311e-4bfd-9d9c-bca8c5d11e79 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:35.816679 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7cfabdea-311e-4bfd-9d9c-bca8c5d11e79 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:35.817150 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7cfabdea-311e-4bfd-9d9c-bca8c5d11e79 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:35.817573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7cfabdea-311e-4bfd-9d9c-bca8c5d11e79 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:35.818251 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7cfabdea-311e-4bfd-9d9c-bca8c5d11e79 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:35.818691 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7cfabdea-311e-4bfd-9d9c-bca8c5d11e79 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:35.819103 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7cfabdea-311e-4bfd-9d9c-bca8c5d11e79 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:35.946650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7cfabdea-311e-4bfd-9d9c-bca8c5d11e79 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:35.954223 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7cfabdea-311e-4bfd-9d9c-bca8c5d11e79 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1548 microversion: 2.1 time: 0.148995 Aug 26 15:54:35.954786 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 257/518] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:35 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:35.975219 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-8f30e330-8ab8-4d39-aee5-49521b8f0e73 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:35.975832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-8f30e330-8ab8-4d39-aee5-49521b8f0e73 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:35.982370 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8f30e330-8ab8-4d39-aee5-49521b8f0e73 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:35.982854 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8f30e330-8ab8-4d39-aee5-49521b8f0e73 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:35.983290 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8f30e330-8ab8-4d39-aee5-49521b8f0e73 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:35.984021 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8f30e330-8ab8-4d39-aee5-49521b8f0e73 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:35.984464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8f30e330-8ab8-4d39-aee5-49521b8f0e73 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:35.984897 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8f30e330-8ab8-4d39-aee5-49521b8f0e73 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:36.061458 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5c7e3064-a848-4889-bd15-0d7a1fc259f5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:36.063937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5c7e3064-a848-4889-bd15-0d7a1fc259f5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:36.070614 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c7e3064-a848-4889-bd15-0d7a1fc259f5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:36.071115 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c7e3064-a848-4889-bd15-0d7a1fc259f5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:36.071551 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c7e3064-a848-4889-bd15-0d7a1fc259f5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:36.072485 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c7e3064-a848-4889-bd15-0d7a1fc259f5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:36.072952 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c7e3064-a848-4889-bd15-0d7a1fc259f5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:36.073384 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5c7e3064-a848-4889-bd15-0d7a1fc259f5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:36.108973 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5c7e3064-a848-4889-bd15-0d7a1fc259f5 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051628 Aug 26 15:54:36.109553 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 258/519] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:54:36 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 15:54:36.131140 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-8f30e330-8ab8-4d39-aee5-49521b8f0e73 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:36.138946 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-8f30e330-8ab8-4d39-aee5-49521b8f0e73 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1548 microversion: 2.1 time: 0.168156 Aug 26 15:54:36.139518 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 262/520] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:35 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:36.161267 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b53c19b1-cfca-4a71-99e9-141f99eec123 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:36.166107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-b53c19b1-cfca-4a71-99e9-141f99eec123 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:36.166991 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b53c19b1-cfca-4a71-99e9-141f99eec123 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Searching by: {'deleted': False, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5'} {{(pid=127698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 26 15:54:36.171639 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1b31d669-cb67-4270-b60c-2d6e112039f4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:36.172233 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1b31d669-cb67-4270-b60c-2d6e112039f4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:36.173921 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b53c19b1-cfca-4a71-99e9-141f99eec123 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:36.174394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b53c19b1-cfca-4a71-99e9-141f99eec123 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:36.174816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b53c19b1-cfca-4a71-99e9-141f99eec123 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:36.176230 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b53c19b1-cfca-4a71-99e9-141f99eec123 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:36.176676 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b53c19b1-cfca-4a71-99e9-141f99eec123 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:36.177090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b53c19b1-cfca-4a71-99e9-141f99eec123 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:36.179137 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b31d669-cb67-4270-b60c-2d6e112039f4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:36.179677 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b31d669-cb67-4270-b60c-2d6e112039f4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:36.180141 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b31d669-cb67-4270-b60c-2d6e112039f4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:36.180864 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b31d669-cb67-4270-b60c-2d6e112039f4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:36.181377 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b31d669-cb67-4270-b60c-2d6e112039f4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:36.181800 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b31d669-cb67-4270-b60c-2d6e112039f4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:36.206584 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1b31d669-cb67-4270-b60c-2d6e112039f4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Going to try to terminate instance {{(pid=127697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:54:36.265929 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.multi_cell_list [None req-b53c19b1-cfca-4a71-99e9-141f99eec123 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 26 15:54:36.365798 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-b53c19b1-cfca-4a71-99e9-141f99eec123 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.208786 Aug 26 15:54:36.366357 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 259/521] 10.222.0.98 () {58 vars in 1125 bytes} [Fri Aug 26 15:54:36 2022] GET /compute/v2.1/servers => generated 342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:36.377853 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-437b5187-79ab-4bc0-815a-b0f9f684e74b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:36.381775 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-437b5187-79ab-4bc0-815a-b0f9f684e74b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:36.384662 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-437b5187-79ab-4bc0-815a-b0f9f684e74b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:36.385151 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-437b5187-79ab-4bc0-815a-b0f9f684e74b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:36.385977 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-437b5187-79ab-4bc0-815a-b0f9f684e74b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:36.386293 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-437b5187-79ab-4bc0-815a-b0f9f684e74b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:36.386745 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-437b5187-79ab-4bc0-815a-b0f9f684e74b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:36.387171 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-437b5187-79ab-4bc0-815a-b0f9f684e74b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:36.485420 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1b31d669-cb67-4270-b60c-2d6e112039f4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 204 len: 0 microversion: 2.1 time: 0.317318 Aug 26 15:54:36.486471 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 263/522] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:54:36 2022] DELETE /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 15:54:36.499436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-ecb416bd-9a01-43bf-b1cc-cf440c3ff946 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:36.500424 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ecb416bd-9a01-43bf-b1cc-cf440c3ff946 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:36.507207 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ecb416bd-9a01-43bf-b1cc-cf440c3ff946 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:36.507696 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ecb416bd-9a01-43bf-b1cc-cf440c3ff946 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:36.508169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ecb416bd-9a01-43bf-b1cc-cf440c3ff946 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:36.508876 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ecb416bd-9a01-43bf-b1cc-cf440c3ff946 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:36.509320 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ecb416bd-9a01-43bf-b1cc-cf440c3ff946 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:36.509743 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ecb416bd-9a01-43bf-b1cc-cf440c3ff946 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:36.542306 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-437b5187-79ab-4bc0-815a-b0f9f684e74b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:36.550410 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-437b5187-79ab-4bc0-815a-b0f9f684e74b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1548 microversion: 2.1 time: 0.176320 Aug 26 15:54:36.550994 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 260/523] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:36 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:54:36.653064 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ecb416bd-9a01-43bf-b1cc-cf440c3ff946 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:36.660933 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-ecb416bd-9a01-43bf-b1cc-cf440c3ff946 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1672 microversion: 2.1 time: 0.165779 Aug 26 15:54:36.661516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 264/524] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:36 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:37.682516 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e12080f0-0d27-4803-89fb-3369c6283af6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:37.683121 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e12080f0-0d27-4803-89fb-3369c6283af6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:37.689982 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e12080f0-0d27-4803-89fb-3369c6283af6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:37.690476 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e12080f0-0d27-4803-89fb-3369c6283af6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:37.690891 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e12080f0-0d27-4803-89fb-3369c6283af6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:37.691573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e12080f0-0d27-4803-89fb-3369c6283af6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:37.692056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e12080f0-0d27-4803-89fb-3369c6283af6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:37.692484 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e12080f0-0d27-4803-89fb-3369c6283af6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:37.826874 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e12080f0-0d27-4803-89fb-3369c6283af6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:37.830480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=100 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:37.836264 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e12080f0-0d27-4803-89fb-3369c6283af6 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1672 microversion: 2.1 time: 0.157543 Aug 26 15:54:37.836840 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 261/525] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:37 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:38.857483 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d6eb3516-5c6d-4a06-a9a1-6d2de05c8f3f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:38.858055 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d6eb3516-5c6d-4a06-a9a1-6d2de05c8f3f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:38.864254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6eb3516-5c6d-4a06-a9a1-6d2de05c8f3f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:38.864732 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6eb3516-5c6d-4a06-a9a1-6d2de05c8f3f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:38.865166 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6eb3516-5c6d-4a06-a9a1-6d2de05c8f3f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:38.865851 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6eb3516-5c6d-4a06-a9a1-6d2de05c8f3f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:38.866299 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6eb3516-5c6d-4a06-a9a1-6d2de05c8f3f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:38.866720 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6eb3516-5c6d-4a06-a9a1-6d2de05c8f3f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:38.994822 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d6eb3516-5c6d-4a06-a9a1-6d2de05c8f3f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:39.002551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d6eb3516-5c6d-4a06-a9a1-6d2de05c8f3f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1672 microversion: 2.1 time: 0.149011 Aug 26 15:54:39.003122 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 265/526] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:38 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:40.024241 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-56e2d6a3-5c39-4972-aed2-af3fc6f15cca tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:40.024890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-56e2d6a3-5c39-4972-aed2-af3fc6f15cca tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:40.031823 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-56e2d6a3-5c39-4972-aed2-af3fc6f15cca tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:40.032332 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-56e2d6a3-5c39-4972-aed2-af3fc6f15cca tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:40.032768 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-56e2d6a3-5c39-4972-aed2-af3fc6f15cca tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:40.033453 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-56e2d6a3-5c39-4972-aed2-af3fc6f15cca tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:40.033911 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-56e2d6a3-5c39-4972-aed2-af3fc6f15cca tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:40.034331 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-56e2d6a3-5c39-4972-aed2-af3fc6f15cca tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:40.163774 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-56e2d6a3-5c39-4972-aed2-af3fc6f15cca tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:40.171452 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-56e2d6a3-5c39-4972-aed2-af3fc6f15cca tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1672 microversion: 2.1 time: 0.151201 Aug 26 15:54:40.172047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 262/527] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:40 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:40.628776 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6faa4b24-d3b5-4cdf-8323-21d918934158 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31c0efc1-6009-4861-a602-bed16e38c004"}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:40.633076 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6faa4b24-d3b5-4cdf-8323-21d918934158 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:40.640429 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6faa4b24-d3b5-4cdf-8323-21d918934158 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:40.640923 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6faa4b24-d3b5-4cdf-8323-21d918934158 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:40.641361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6faa4b24-d3b5-4cdf-8323-21d918934158 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:40.642367 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6faa4b24-d3b5-4cdf-8323-21d918934158 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:40.642826 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6faa4b24-d3b5-4cdf-8323-21d918934158 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:40.643788 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6faa4b24-d3b5-4cdf-8323-21d918934158 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:40.676141 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-440880762", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "networks": [{"uuid": "1d5138f4-1909-488f-bfaa-fb93ef1d71dc"}]}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:40.740006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.network.neutron [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] validate_networks() for [('1d5138f4-1909-488f-bfaa-fb93ef1d71dc', None, None, None, None, None)] {{(pid=127698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:54:41.470942 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Flavor limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:54:41.471602 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Image limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:54:41.471893 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Flavor pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:54:41.474937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Image pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:54:41.475355 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:54:41.484523 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:41.485007 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:41.485441 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:41.486171 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:41.486623 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:41.487048 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:41.506096 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Getting quotas for project 7e4bab21dc3141bd89ee2ea54fe0c14c. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:54:41.511035 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6faa4b24-d3b5-4cdf-8323-21d918934158 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "POST /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.888221 Aug 26 15:54:41.517051 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 266/528] 10.222.0.98 () {60 vars in 1323 bytes} [Fri Aug 26 15:54:40 2022] POST /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:54:41.517227 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Getting quotas for user 28436612400e421ca52f902542186a68 and project 7e4bab21dc3141bd89ee2ea54fe0c14c. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:54:41.524870 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-06a73e22-6b92-4736-bf3c-53ce1fce0035 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:41.525535 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-06a73e22-6b92-4736-bf3c-53ce1fce0035 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:41.536836 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06a73e22-6b92-4736-bf3c-53ce1fce0035 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:41.537252 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06a73e22-6b92-4736-bf3c-53ce1fce0035 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:41.537690 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06a73e22-6b92-4736-bf3c-53ce1fce0035 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:41.538403 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06a73e22-6b92-4736-bf3c-53ce1fce0035 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:41.538855 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06a73e22-6b92-4736-bf3c-53ce1fce0035 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:41.539278 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06a73e22-6b92-4736-bf3c-53ce1fce0035 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:41.540980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Going to run 1 instances... {{(pid=127698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:54:41.545362 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:54:41.610923 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-06a73e22-6b92-4736-bf3c-53ce1fce0035 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:41.620239 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-06a73e22-6b92-4736-bf3c-53ce1fce0035 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1605 microversion: 2.1 time: 0.107324 Aug 26 15:54:41.623540 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 267/529] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:41 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1605 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:41.666039 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-b2d8e64d-9105-4164-9ba0-fc09ac39502f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994607 Aug 26 15:54:41.667398 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 263/530] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:54:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 15:54:41.678756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-8f92552c-7e2a-415e-93f8-fd62a57cfec6 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:41.679375 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-8f92552c-7e2a-415e-93f8-fd62a57cfec6 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:41.785875 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-8f92552c-7e2a-415e-93f8-fd62a57cfec6 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:41.797489 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-8f92552c-7e2a-415e-93f8-fd62a57cfec6 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1218 microversion: 2.1 time: 0.123221 Aug 26 15:54:41.798185 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 268/531] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:41 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:41.873882 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-09ad655a-f0af-4e08-8b6a-164ae4a116f2 req-39c12d43-5694-40bb-9fc2-7d363c8f025d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bdeefc3-4622-43da-a414-d7813721bc01", "name": "network-vif-deleted", "tag": "35e38d0a-ebb0-4877-bfe3-31b8806f3fde"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:41.890733 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-09ad655a-f0af-4e08-8b6a-164ae4a116f2 req-39c12d43-5694-40bb-9fc2-7d363c8f025d service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:41.891216 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-09ad655a-f0af-4e08-8b6a-164ae4a116f2 req-39c12d43-5694-40bb-9fc2-7d363c8f025d service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:41.891660 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-09ad655a-f0af-4e08-8b6a-164ae4a116f2 req-39c12d43-5694-40bb-9fc2-7d363c8f025d service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:41.908501 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-09ad655a-f0af-4e08-8b6a-164ae4a116f2 req-39c12d43-5694-40bb-9fc2-7d363c8f025d service nova] Creating event network-vif-deleted:35e38d0a-ebb0-4877-bfe3-31b8806f3fde for instance 6bdeefc3-4622-43da-a414-d7813721bc01 on hv-cinder-83124 Aug 26 15:54:41.913303 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-09ad655a-f0af-4e08-8b6a-164ae4a116f2 req-39c12d43-5694-40bb-9fc2-7d363c8f025d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046374 Aug 26 15:54:41.914272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 264/532] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:42.645903 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a2a5aaaa-c457-4643-85ad-407136d14d87 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:42.646475 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a2a5aaaa-c457-4643-85ad-407136d14d87 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:42.659091 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a2a5aaaa-c457-4643-85ad-407136d14d87 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:42.659783 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a2a5aaaa-c457-4643-85ad-407136d14d87 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:42.660538 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a2a5aaaa-c457-4643-85ad-407136d14d87 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:42.661419 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a2a5aaaa-c457-4643-85ad-407136d14d87 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:42.662049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a2a5aaaa-c457-4643-85ad-407136d14d87 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:42.662803 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a2a5aaaa-c457-4643-85ad-407136d14d87 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:42.704242 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a2a5aaaa-c457-4643-85ad-407136d14d87 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:42.704925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a2a5aaaa-c457-4643-85ad-407136d14d87 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:42.705247 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a2a5aaaa-c457-4643-85ad-407136d14d87 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:42.705703 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-a2a5aaaa-c457-4643-85ad-407136d14d87 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lazy-loading 'fault' on Instance uuid 6bdeefc3-4622-43da-a414-d7813721bc01 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:54:42.750719 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a2a5aaaa-c457-4643-85ad-407136d14d87 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:42.758691 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a2a5aaaa-c457-4643-85ad-407136d14d87 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1327 microversion: 2.1 time: 0.117539 Aug 26 15:54:42.759284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 269/533] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:42 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1327 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:42.822060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1a28ec82-786c-4aef-9533-2310a7443dcb tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:42.823016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-1a28ec82-786c-4aef-9533-2310a7443dcb tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:42.881200 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1a28ec82-786c-4aef-9533-2310a7443dcb tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:42.889017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-1a28ec82-786c-4aef-9533-2310a7443dcb tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1218 microversion: 2.1 time: 0.071997 Aug 26 15:54:42.900403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 265/534] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:42 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:43.780350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f62acabb-ce8b-445d-919e-de22bd5d4452 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:43.780990 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f62acabb-ce8b-445d-919e-de22bd5d4452 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:43.788548 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f62acabb-ce8b-445d-919e-de22bd5d4452 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:43.789091 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f62acabb-ce8b-445d-919e-de22bd5d4452 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:43.789535 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f62acabb-ce8b-445d-919e-de22bd5d4452 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:43.790234 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f62acabb-ce8b-445d-919e-de22bd5d4452 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:43.790685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f62acabb-ce8b-445d-919e-de22bd5d4452 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:43.791110 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f62acabb-ce8b-445d-919e-de22bd5d4452 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:43.824579 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f62acabb-ce8b-445d-919e-de22bd5d4452 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:43.825059 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f62acabb-ce8b-445d-919e-de22bd5d4452 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:43.825491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f62acabb-ce8b-445d-919e-de22bd5d4452 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:43.825932 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-f62acabb-ce8b-445d-919e-de22bd5d4452 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lazy-loading 'fault' on Instance uuid 6bdeefc3-4622-43da-a414-d7813721bc01 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:54:43.870158 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f62acabb-ce8b-445d-919e-de22bd5d4452 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:43.879111 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f62acabb-ce8b-445d-919e-de22bd5d4452 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 200 len: 1327 microversion: 2.1 time: 0.102685 Aug 26 15:54:43.880088 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 270/535] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:43 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:43.911049 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3b75c995-0dbb-46bf-8a1a-a86520a34efa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:43.912098 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3b75c995-0dbb-46bf-8a1a-a86520a34efa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:43.921444 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3b75c995-0dbb-46bf-8a1a-a86520a34efa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:43.924074 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3b75c995-0dbb-46bf-8a1a-a86520a34efa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:43.924074 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3b75c995-0dbb-46bf-8a1a-a86520a34efa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:43.924074 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3b75c995-0dbb-46bf-8a1a-a86520a34efa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:43.924074 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3b75c995-0dbb-46bf-8a1a-a86520a34efa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:43.924462 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3b75c995-0dbb-46bf-8a1a-a86520a34efa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:43.997192 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3b75c995-0dbb-46bf-8a1a-a86520a34efa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:44.005087 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3b75c995-0dbb-46bf-8a1a-a86520a34efa tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1214 microversion: 2.1 time: 0.098375 Aug 26 15:54:44.005647 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 266/536] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:43 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:44.900407 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-75b31206-21c8-42b0-b713-6b1851528d8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:44.900966 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-75b31206-21c8-42b0-b713-6b1851528d8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:44.908750 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-75b31206-21c8-42b0-b713-6b1851528d8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:44.909232 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-75b31206-21c8-42b0-b713-6b1851528d8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:44.909666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-75b31206-21c8-42b0-b713-6b1851528d8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:44.910357 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-75b31206-21c8-42b0-b713-6b1851528d8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:44.910804 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-75b31206-21c8-42b0-b713-6b1851528d8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:44.911223 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-75b31206-21c8-42b0-b713-6b1851528d8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:44.924751 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-75b31206-21c8-42b0-b713-6b1851528d8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] HTTP exception thrown: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-75b31206-21c8-42b0-b713-6b1851528d8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Request method failure captured: Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 HTTP/1.1 Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOuztnIGz-tC6orC6IJ_OI0N4kToQrIvAZwSeYvWRd_lulVdg6BvI_S4_6o_OoCs48o7yT3Om6ExAlW2QobVVAI6wZunYrhVluIk49mm7WCC2qgOIY7wIvXO_SMioyl5iatFC4WYexj6mh5L4tyUh_4_2KyytsRXOKulcn2fHGY3QOI Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: bc372e59524442debba38c57df458071 Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:54:44.926390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:54:44.927856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/bc372e59524442debba38c57df458071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_bc372e59524442debba38c57df458071", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bc372e59524442debba38c57df458071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bc372e59524442debba38c57df458071"}]}] Aug 26 15:54:44.927856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:54:44.927856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: bc372e59524442debba38c57df458071 Aug 26 15:54:44.927856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:54:44.927856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-AttachVolumeTestJSON-786876667-project Aug 26 15:54:44.927856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:54:44.927856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:54:44.927856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 6861433b9f4441fe842b506def255c58 Aug 26 15:54:44.927856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-AttachVolumeTestJSON-786876667-project Aug 26 15:54:44.927856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:54:44.927856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. Aug 26 15:54:44.927856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '6bdeefc3-4622-43da-a414-d7813721bc01'} Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:54:44.928749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. Aug 26 15:54:44.930086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:54:44.931226 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-75b31206-21c8-42b0-b713-6b1851528d8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Returning 404 to user: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:54:44.931226 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-75b31206-21c8-42b0-b713-6b1851528d8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 404 len: 111 microversion: 2.1 time: 0.031426 Aug 26 15:54:44.931226 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 271/537] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:44 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:54:44.937202 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-50e51d96-e6c5-4601-8a9a-bc7953fe4cab tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '.version_select at 0x7fbd1e602310>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:45.007281 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-50e51d96-e6c5-4601-8a9a-bc7953fe4cab tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750781866" status: 202 len: 0 microversion: 2.1 time: 0.073812 Aug 26 15:54:45.008321 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 267/538] 10.222.0.98 () {58 vars in 1221 bytes} [Fri Aug 26 15:54:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750781866 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:54:45.027024 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-afd5595c-f918-450c-adda-737c46e154f4 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:45.028130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-afd5595c-f918-450c-adda-737c46e154f4 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:45.038897 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-afd5595c-f918-450c-adda-737c46e154f4 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:45.039634 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-afd5595c-f918-450c-adda-737c46e154f4 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:45.040102 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-afd5595c-f918-450c-adda-737c46e154f4 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:45.041144 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-afd5595c-f918-450c-adda-737c46e154f4 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:45.041628 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-afd5595c-f918-450c-adda-737c46e154f4 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:45.042054 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-afd5595c-f918-450c-adda-737c46e154f4 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:45.122958 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-afd5595c-f918-450c-adda-737c46e154f4 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:45.143327 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-afd5595c-f918-450c-adda-737c46e154f4 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1278 microversion: 2.1 time: 0.121138 Aug 26 15:54:45.143947 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 272/539] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:45 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:46.172675 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-50999bcd-09d7-434c-8fb7-0d4d2f42acc0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:46.173293 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-50999bcd-09d7-434c-8fb7-0d4d2f42acc0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:46.180637 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-50999bcd-09d7-434c-8fb7-0d4d2f42acc0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:46.181111 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-50999bcd-09d7-434c-8fb7-0d4d2f42acc0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:46.181535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-50999bcd-09d7-434c-8fb7-0d4d2f42acc0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:46.182221 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-50999bcd-09d7-434c-8fb7-0d4d2f42acc0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:46.182664 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-50999bcd-09d7-434c-8fb7-0d4d2f42acc0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:46.183080 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-50999bcd-09d7-434c-8fb7-0d4d2f42acc0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:46.199415 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7486fece-9e98-46be-84cd-407307af1418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Action: 'create', calling method: .version_select at 0x7fbd1e2d81f0>, body: {"keypair": {"name": "tempest-keypair-2122624495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYGXpJIA7GjlOuPO4Wz92Yuu8Wf5KVfu/KlntvU7m+nsAKOvQ4EkgoAcycl/ZRJjdvwEtHxegHVihVfnHwCxYj6+j/b4ktPqL5mGsCX9LvmSjD+f+RN4tFW1MuqcjjYAA=="}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:46.220291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-7486fece-9e98-46be-84cd-407307af1418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Getting quotas for project bc372e59524442debba38c57df458071. Resources: {'key_pairs'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:54:46.225326 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-7486fece-9e98-46be-84cd-407307af1418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Getting quotas for user 6861433b9f4441fe842b506def255c58 and project bc372e59524442debba38c57df458071. Resources: {'key_pairs'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:54:46.284168 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7486fece-9e98-46be-84cd-407307af1418 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088862 Aug 26 15:54:46.285373 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 273/540] 10.222.0.98 () {60 vars in 1159 bytes} [Fri Aug 26 15:54:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:54:46.384769 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-50999bcd-09d7-434c-8fb7-0d4d2f42acc0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:46.392969 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-50999bcd-09d7-434c-8fb7-0d4d2f42acc0 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1318 microversion: 2.1 time: 0.224241 Aug 26 15:54:46.393947 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 268/541] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:46 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:47.077154 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-e2388a84-41bc-4275-aebf-201249dbf7a3 req-b6ea6656-a048-457a-8c94-07ba105a46b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e9b0b71-315c-4701-8d05-04ad47287f13", "tag": "c403c367-d759-4ca4-b284-2bda6e58d872"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:47.088822 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-e2388a84-41bc-4275-aebf-201249dbf7a3 req-b6ea6656-a048-457a-8c94-07ba105a46b0 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:47.089309 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-e2388a84-41bc-4275-aebf-201249dbf7a3 req-b6ea6656-a048-457a-8c94-07ba105a46b0 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:47.089745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-e2388a84-41bc-4275-aebf-201249dbf7a3 req-b6ea6656-a048-457a-8c94-07ba105a46b0 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:47.094056 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:47.101970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-e2388a84-41bc-4275-aebf-201249dbf7a3 req-b6ea6656-a048-457a-8c94-07ba105a46b0 service nova] Creating event network-changed:c403c367-d759-4ca4-b284-2bda6e58d872 for instance 5e9b0b71-315c-4701-8d05-04ad47287f13 on hv-cinder-83124 Aug 26 15:54:47.106653 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-e2388a84-41bc-4275-aebf-201249dbf7a3 req-b6ea6656-a048-457a-8c94-07ba105a46b0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033236 Aug 26 15:54:47.107237 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 274/542] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:47.416698 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-27314365-bf87-4695-92b8-f516a40ce8d7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:47.417342 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-27314365-bf87-4695-92b8-f516a40ce8d7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:47.424542 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27314365-bf87-4695-92b8-f516a40ce8d7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:47.425034 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27314365-bf87-4695-92b8-f516a40ce8d7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:47.426345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27314365-bf87-4695-92b8-f516a40ce8d7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:47.427401 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27314365-bf87-4695-92b8-f516a40ce8d7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:47.427892 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27314365-bf87-4695-92b8-f516a40ce8d7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:47.428561 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27314365-bf87-4695-92b8-f516a40ce8d7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:47.608390 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-27314365-bf87-4695-92b8-f516a40ce8d7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:47.617896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-27314365-bf87-4695-92b8-f516a40ce8d7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1318 microversion: 2.1 time: 0.205695 Aug 26 15:54:47.618511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 269/543] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:47 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:48.616543 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-402321092", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6bb34042-8beb-46ad-9c5c-3a292ab0e4d8"}], "security_groups": [{"name": "tempest-securitygroup--1062102801"}], "key_name": "tempest-keypair-2122624495", "user_data": "}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:48.638905 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-65417093-3591-4c14-a128-217c8e03ae21 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:48.639511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-65417093-3591-4c14-a128-217c8e03ae21 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:48.647182 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65417093-3591-4c14-a128-217c8e03ae21 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:48.647605 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65417093-3591-4c14-a128-217c8e03ae21 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:48.648084 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65417093-3591-4c14-a128-217c8e03ae21 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:48.648793 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65417093-3591-4c14-a128-217c8e03ae21 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:48.649249 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65417093-3591-4c14-a128-217c8e03ae21 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:48.649675 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65417093-3591-4c14-a128-217c8e03ae21 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:48.741488 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.network.neutron [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] validate_networks() for [('6bb34042-8beb-46ad-9c5c-3a292ab0e4d8', None, None, None, None, None)] {{(pid=127697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:54:48.785566 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-65417093-3591-4c14-a128-217c8e03ae21 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:48.793685 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-65417093-3591-4c14-a128-217c8e03ae21 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1318 microversion: 2.1 time: 0.158818 Aug 26 15:54:48.794218 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 270/544] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:48 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:54:49.116783 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Flavor limits 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:54:49.117341 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Image limits 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:54:49.117820 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Flavor pref 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:54:49.118259 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Image pref 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:54:49.118670 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:54:49.127797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:49.128232 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:49.129296 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:49.130013 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:49.130455 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:49.130930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:49.147451 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Getting quotas for project bc372e59524442debba38c57df458071. Resources: {'ram', 'cores', 'instances'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:54:49.151551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Getting quotas for user 6861433b9f4441fe842b506def255c58 and project bc372e59524442debba38c57df458071. Resources: {'ram', 'cores', 'instances'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:54:49.162646 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Going to run 1 instances... {{(pid=127697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:54:49.165127 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:54:49.363354 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-af31df93-e13b-4b83-9940-f1de5385c900 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.752589 Aug 26 15:54:49.364045 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 275/545] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:54:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:54:49.374885 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-fb7e3e3b-1ab5-4f95-9176-1bb0f465b13f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:49.375531 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-fb7e3e3b-1ab5-4f95-9176-1bb0f465b13f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:49.432727 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-fb7e3e3b-1ab5-4f95-9176-1bb0f465b13f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:49.439649 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-fb7e3e3b-1ab5-4f95-9176-1bb0f465b13f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1237 microversion: 2.1 time: 0.068549 Aug 26 15:54:49.440320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 271/546] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:49 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:54:49.814966 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-4b4ec3de-b636-4b08-b1dd-15b07d5c1bbc tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:49.815573 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-4b4ec3de-b636-4b08-b1dd-15b07d5c1bbc tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:49.823428 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4b4ec3de-b636-4b08-b1dd-15b07d5c1bbc tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:49.823929 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4b4ec3de-b636-4b08-b1dd-15b07d5c1bbc tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:49.824359 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4b4ec3de-b636-4b08-b1dd-15b07d5c1bbc tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:49.825055 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4b4ec3de-b636-4b08-b1dd-15b07d5c1bbc tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:49.825496 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4b4ec3de-b636-4b08-b1dd-15b07d5c1bbc tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:49.825909 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4b4ec3de-b636-4b08-b1dd-15b07d5c1bbc tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:49.960634 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-4b4ec3de-b636-4b08-b1dd-15b07d5c1bbc tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:49.972297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-4b4ec3de-b636-4b08-b1dd-15b07d5c1bbc tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1318 microversion: 2.1 time: 0.161288 Aug 26 15:54:49.973058 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 276/547] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:49 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:50.460625 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1110b141-435a-4160-9f5f-f5f3513fb172 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:50.461196 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-1110b141-435a-4160-9f5f-f5f3513fb172 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:50.467775 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1110b141-435a-4160-9f5f-f5f3513fb172 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:50.468297 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1110b141-435a-4160-9f5f-f5f3513fb172 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:50.468735 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1110b141-435a-4160-9f5f-f5f3513fb172 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:50.469430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1110b141-435a-4160-9f5f-f5f3513fb172 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:50.469883 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1110b141-435a-4160-9f5f-f5f3513fb172 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:50.470306 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1110b141-435a-4160-9f5f-f5f3513fb172 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:50.532457 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1110b141-435a-4160-9f5f-f5f3513fb172 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:50.541155 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-1110b141-435a-4160-9f5f-f5f3513fb172 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1241 microversion: 2.1 time: 0.084393 Aug 26 15:54:50.541724 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 272/548] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:50 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:50.994844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7fdb678d-b31f-4696-9ec2-66e12c18f358 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:50.996081 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7fdb678d-b31f-4696-9ec2-66e12c18f358 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:51.003468 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fdb678d-b31f-4696-9ec2-66e12c18f358 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:51.003987 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fdb678d-b31f-4696-9ec2-66e12c18f358 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:51.004423 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fdb678d-b31f-4696-9ec2-66e12c18f358 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:51.005124 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fdb678d-b31f-4696-9ec2-66e12c18f358 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:51.005576 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fdb678d-b31f-4696-9ec2-66e12c18f358 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:51.006000 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fdb678d-b31f-4696-9ec2-66e12c18f358 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:51.138555 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7fdb678d-b31f-4696-9ec2-66e12c18f358 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:51.146572 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7fdb678d-b31f-4696-9ec2-66e12c18f358 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1318 microversion: 2.1 time: 0.156748 Aug 26 15:54:51.147152 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 277/549] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:50 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:51.423890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-91ef849c-0afa-44e5-a038-49dd19cc065a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:51.424525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-91ef849c-0afa-44e5-a038-49dd19cc065a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:51.426544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:51.431187 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91ef849c-0afa-44e5-a038-49dd19cc065a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:51.431669 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91ef849c-0afa-44e5-a038-49dd19cc065a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:51.432141 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91ef849c-0afa-44e5-a038-49dd19cc065a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:51.432833 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91ef849c-0afa-44e5-a038-49dd19cc065a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:51.433280 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91ef849c-0afa-44e5-a038-49dd19cc065a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:51.433700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91ef849c-0afa-44e5-a038-49dd19cc065a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:51.497107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=4 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:51.561736 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-ebe69d07-f63a-4423-bd98-b30bbd69b549 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:51.562542 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ebe69d07-f63a-4423-bd98-b30bbd69b549 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:51.564347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-91ef849c-0afa-44e5-a038-49dd19cc065a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:51.568762 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ebe69d07-f63a-4423-bd98-b30bbd69b549 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:51.569325 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ebe69d07-f63a-4423-bd98-b30bbd69b549 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:51.569834 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ebe69d07-f63a-4423-bd98-b30bbd69b549 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:51.570861 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ebe69d07-f63a-4423-bd98-b30bbd69b549 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:51.571382 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ebe69d07-f63a-4423-bd98-b30bbd69b549 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:51.571914 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ebe69d07-f63a-4423-bd98-b30bbd69b549 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:51.573076 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-91ef849c-0afa-44e5-a038-49dd19cc065a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1594 microversion: 2.1 time: 0.152844 Aug 26 15:54:51.573510 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 273/550] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:51 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:51.638338 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ebe69d07-f63a-4423-bd98-b30bbd69b549 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:51.646856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-ebe69d07-f63a-4423-bd98-b30bbd69b549 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1289 microversion: 2.1 time: 0.089003 Aug 26 15:54:51.647437 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 278/551] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:51 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:54:52.168509 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-877c4733-0b30-4c28-a014-96ddd13ba33f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:52.172171 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-877c4733-0b30-4c28-a014-96ddd13ba33f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:52.177016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-877c4733-0b30-4c28-a014-96ddd13ba33f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:52.177613 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-877c4733-0b30-4c28-a014-96ddd13ba33f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:52.178125 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-877c4733-0b30-4c28-a014-96ddd13ba33f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:52.178956 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-877c4733-0b30-4c28-a014-96ddd13ba33f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:52.179484 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-877c4733-0b30-4c28-a014-96ddd13ba33f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:52.180157 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-877c4733-0b30-4c28-a014-96ddd13ba33f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:52.407759 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-877c4733-0b30-4c28-a014-96ddd13ba33f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:52.413723 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-877c4733-0b30-4c28-a014-96ddd13ba33f tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1318 microversion: 2.1 time: 0.249204 Aug 26 15:54:52.414505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 274/552] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:52 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:52.671230 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-73817aa2-53dd-4cd6-9eb1-18ebf67fbba0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:52.671230 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-73817aa2-53dd-4cd6-9eb1-18ebf67fbba0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:52.677252 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-73817aa2-53dd-4cd6-9eb1-18ebf67fbba0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:52.677742 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-73817aa2-53dd-4cd6-9eb1-18ebf67fbba0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:52.678182 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-73817aa2-53dd-4cd6-9eb1-18ebf67fbba0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:52.678884 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-73817aa2-53dd-4cd6-9eb1-18ebf67fbba0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:52.679336 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-73817aa2-53dd-4cd6-9eb1-18ebf67fbba0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:52.679757 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-73817aa2-53dd-4cd6-9eb1-18ebf67fbba0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:52.784272 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-73817aa2-53dd-4cd6-9eb1-18ebf67fbba0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:52.792824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-73817aa2-53dd-4cd6-9eb1-18ebf67fbba0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1295 microversion: 2.1 time: 0.127660 Aug 26 15:54:52.793404 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 279/553] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:52 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1295 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:53.437569 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4c6af53a-12fa-4ceb-80a2-c95a1a96cda7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:53.437569 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-4c6af53a-12fa-4ceb-80a2-c95a1a96cda7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:53.443962 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4c6af53a-12fa-4ceb-80a2-c95a1a96cda7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:53.444457 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4c6af53a-12fa-4ceb-80a2-c95a1a96cda7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:53.444890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4c6af53a-12fa-4ceb-80a2-c95a1a96cda7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:53.445837 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4c6af53a-12fa-4ceb-80a2-c95a1a96cda7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:53.446276 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4c6af53a-12fa-4ceb-80a2-c95a1a96cda7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:53.446691 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4c6af53a-12fa-4ceb-80a2-c95a1a96cda7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:53.685050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4c6af53a-12fa-4ceb-80a2-c95a1a96cda7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:53.692128 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4c6af53a-12fa-4ceb-80a2-c95a1a96cda7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1318 microversion: 2.1 time: 0.260870 Aug 26 15:54:53.705706 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 275/554] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:53 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:53.814502 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-66464fe8-ca52-41bc-a737-72cdc6779132 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:53.815117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-66464fe8-ca52-41bc-a737-72cdc6779132 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:53.822656 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-66464fe8-ca52-41bc-a737-72cdc6779132 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:53.823143 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-66464fe8-ca52-41bc-a737-72cdc6779132 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:53.823576 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-66464fe8-ca52-41bc-a737-72cdc6779132 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:53.824299 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-66464fe8-ca52-41bc-a737-72cdc6779132 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:53.824753 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-66464fe8-ca52-41bc-a737-72cdc6779132 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:53.825173 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-66464fe8-ca52-41bc-a737-72cdc6779132 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:53.886984 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-8a08233d-c767-4de2-b187-fb2da6b88df1 req-f3b4ece4-5bb5-49a2-8b20-d16a163c794d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0a2d2ae-7ca7-4e36-8a70-14dc24125e00", "tag": "9b82b23b-877d-4880-a87b-652c8b6c2ae6"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:53.912580 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-8a08233d-c767-4de2-b187-fb2da6b88df1 req-f3b4ece4-5bb5-49a2-8b20-d16a163c794d service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:53.913846 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-8a08233d-c767-4de2-b187-fb2da6b88df1 req-f3b4ece4-5bb5-49a2-8b20-d16a163c794d service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:53.915100 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-8a08233d-c767-4de2-b187-fb2da6b88df1 req-f3b4ece4-5bb5-49a2-8b20-d16a163c794d service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:53.941953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-8a08233d-c767-4de2-b187-fb2da6b88df1 req-f3b4ece4-5bb5-49a2-8b20-d16a163c794d service nova] Creating event network-changed:9b82b23b-877d-4880-a87b-652c8b6c2ae6 for instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 on hv-cinder-83124 Aug 26 15:54:53.953018 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-8a08233d-c767-4de2-b187-fb2da6b88df1 req-f3b4ece4-5bb5-49a2-8b20-d16a163c794d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073374 Aug 26 15:54:53.954536 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 276/555] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:53.997929 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-2464e2de-aa3b-4a94-a997-20a801eae8d5 req-ea924e31-239a-4481-84b3-46c85a7b9137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e9b0b71-315c-4701-8d05-04ad47287f13", "name": "network-vif-plugged", "status": "completed", "tag": "c403c367-d759-4ca4-b284-2bda6e58d872"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:54.017603 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-2464e2de-aa3b-4a94-a997-20a801eae8d5 req-ea924e31-239a-4481-84b3-46c85a7b9137 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:54.018444 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-2464e2de-aa3b-4a94-a997-20a801eae8d5 req-ea924e31-239a-4481-84b3-46c85a7b9137 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:54.019261 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-2464e2de-aa3b-4a94-a997-20a801eae8d5 req-ea924e31-239a-4481-84b3-46c85a7b9137 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:54.042102 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-2464e2de-aa3b-4a94-a997-20a801eae8d5 req-ea924e31-239a-4481-84b3-46c85a7b9137 service nova] Creating event network-vif-plugged:c403c367-d759-4ca4-b284-2bda6e58d872 for instance 5e9b0b71-315c-4701-8d05-04ad47287f13 on hv-cinder-83124 Aug 26 15:54:54.049904 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-2464e2de-aa3b-4a94-a997-20a801eae8d5 req-ea924e31-239a-4481-84b3-46c85a7b9137 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060113 Aug 26 15:54:54.051634 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 277/556] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:54.089111 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-66464fe8-ca52-41bc-a737-72cdc6779132 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:54.098056 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-66464fe8-ca52-41bc-a737-72cdc6779132 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1363 microversion: 2.1 time: 0.286920 Aug 26 15:54:54.108043 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 280/557] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:53 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:54.173026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-df41ae19-8deb-4ba4-b40b-c36107328c0f req-add7e2f4-0d7b-4666-bc3b-baed2d50c037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe4d635-4211-49a0-99c5-aa69824b0de6", "tag": "c3463a69-702b-4594-8fcf-701aaf1b3696"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:54.189581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-df41ae19-8deb-4ba4-b40b-c36107328c0f req-add7e2f4-0d7b-4666-bc3b-baed2d50c037 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:54.192244 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-df41ae19-8deb-4ba4-b40b-c36107328c0f req-add7e2f4-0d7b-4666-bc3b-baed2d50c037 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:54.192244 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-df41ae19-8deb-4ba4-b40b-c36107328c0f req-add7e2f4-0d7b-4666-bc3b-baed2d50c037 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:54.207215 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-df41ae19-8deb-4ba4-b40b-c36107328c0f req-add7e2f4-0d7b-4666-bc3b-baed2d50c037 service nova] Creating event network-changed:c3463a69-702b-4594-8fcf-701aaf1b3696 for instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 on hv-cinder-83124 Aug 26 15:54:54.213003 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-df41ae19-8deb-4ba4-b40b-c36107328c0f req-add7e2f4-0d7b-4666-bc3b-baed2d50c037 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044595 Aug 26 15:54:54.215300 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 278/558] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:54.713761 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c8b78fb3-76e9-48e9-9582-85254ac398fe tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:54.714707 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c8b78fb3-76e9-48e9-9582-85254ac398fe tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:54.722136 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c8b78fb3-76e9-48e9-9582-85254ac398fe tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:54.723169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c8b78fb3-76e9-48e9-9582-85254ac398fe tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:54.723607 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c8b78fb3-76e9-48e9-9582-85254ac398fe tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:54.724336 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c8b78fb3-76e9-48e9-9582-85254ac398fe tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:54.724788 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c8b78fb3-76e9-48e9-9582-85254ac398fe tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:54.725248 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c8b78fb3-76e9-48e9-9582-85254ac398fe tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:54.895636 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c8b78fb3-76e9-48e9-9582-85254ac398fe tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:54.904215 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c8b78fb3-76e9-48e9-9582-85254ac398fe tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1318 microversion: 2.1 time: 0.194581 Aug 26 15:54:54.905520 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 281/559] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:54 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:55.120952 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-bd65b083-87c5-4aac-b74a-dbfefb5b9c7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:55.121780 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-bd65b083-87c5-4aac-b74a-dbfefb5b9c7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:55.137012 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd65b083-87c5-4aac-b74a-dbfefb5b9c7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:55.137645 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd65b083-87c5-4aac-b74a-dbfefb5b9c7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:55.138145 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd65b083-87c5-4aac-b74a-dbfefb5b9c7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:55.138944 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd65b083-87c5-4aac-b74a-dbfefb5b9c7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:55.139523 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd65b083-87c5-4aac-b74a-dbfefb5b9c7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:55.140052 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd65b083-87c5-4aac-b74a-dbfefb5b9c7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:55.317628 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-bd65b083-87c5-4aac-b74a-dbfefb5b9c7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:55.326170 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-bd65b083-87c5-4aac-b74a-dbfefb5b9c7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1363 microversion: 2.1 time: 0.209835 Aug 26 15:54:55.326861 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 279/560] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:55 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:55.523473 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-97f17b11-19c0-40e0-84e0-6372333ffe20 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:55.524338 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-97f17b11-19c0-40e0-84e0-6372333ffe20 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:55.530635 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-97f17b11-19c0-40e0-84e0-6372333ffe20 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:55.531215 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-97f17b11-19c0-40e0-84e0-6372333ffe20 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:55.531983 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-97f17b11-19c0-40e0-84e0-6372333ffe20 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:55.532922 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-97f17b11-19c0-40e0-84e0-6372333ffe20 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:55.534161 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-97f17b11-19c0-40e0-84e0-6372333ffe20 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:55.535571 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-97f17b11-19c0-40e0-84e0-6372333ffe20 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:55.564075 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-97f17b11-19c0-40e0-84e0-6372333ffe20 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f/ips" status: 200 len: 149 microversion: 2.1 time: 0.044766 Aug 26 15:54:55.564660 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 282/561] 10.222.0.98 () {58 vars in 1248 bytes} [Fri Aug 26 15:54:55 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:55.576937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-185f70bd-4000-4c32-95c0-237bc78fe9f0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0f3c062-35ae-426e-bb26-695869ec48b5"}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:55.579357 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-185f70bd-4000-4c32-95c0-237bc78fe9f0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:55.585618 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-185f70bd-4000-4c32-95c0-237bc78fe9f0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:55.586100 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-185f70bd-4000-4c32-95c0-237bc78fe9f0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:55.586574 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-185f70bd-4000-4c32-95c0-237bc78fe9f0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:55.587270 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-185f70bd-4000-4c32-95c0-237bc78fe9f0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:55.587720 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-185f70bd-4000-4c32-95c0-237bc78fe9f0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:55.588171 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-185f70bd-4000-4c32-95c0-237bc78fe9f0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:55.679984 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-185f70bd-4000-4c32-95c0-237bc78fe9f0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] HTTP exception thrown: Invalid volume: volume e0f3c062-35ae-426e-bb26-695869ec48b5 is already attached to instances: 241a08df-4027-4153-8284-9ef744c15cb5 Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-185f70bd-4000-4c32-95c0-237bc78fe9f0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Request method failure captured: Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: POST /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f/os-volume_attachments HTTP/1.1 Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 74 Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOwce1DELhS8UmzpwnI-HX_EQrzE1_2dLaZIAb4DQQsaHzNq-4kKoCdv0aDJeKx2SvQqLHnYNV9XirCc5SAbojp-C1CHsa7OjA6o0rOrx5rLneplb_EX2pmB01iYBvFpO8o6110oFO2yAC5E6SvWdsfGmZrZ7TZSaR32s4VudVlpurQ Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:54:55.681728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:54:55.683024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f40d6476c750438c9c09107c7757fa95", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}] Aug 26 15:54:55.683024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:54:55.683024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:54:55.683024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:54:55.683024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:54:55.683024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:54:55.683024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:54:55.683024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 9348310fd06b473786d1c6be4f20c481 Aug 26 15:54:55.683024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:54:55.683024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Aug 26 15:54:55.683024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {"volumeAttachment": {"volumeId": "e0f3c062-35ae-426e-bb26-695869ec48b5"}} Aug 26 15:54:55.683024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Invalid volume: volume e0f3c062-35ae-426e-bb26-695869ec48b5 is already attached to instances: 241a08df-4027-4153-8284-9ef744c15cb5 Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'server_id': '9af463f4-5ec2-4134-81cf-bd9adfc4853f', 'body': {'volumeAttachment': {'volumeId': 'e0f3c062-35ae-426e-bb26-695869ec48b5'}}} Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e0f3c062-35ae-426e-bb26-695869ec48b5 is already attached to instances: 241a08df-4027-4153-8284-9ef744c15cb5 Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:54:55.683816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e0f3c062-35ae-426e-bb26-695869ec48b5 is already attached to instances: 241a08df-4027-4153-8284-9ef744c15cb5 Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:54:55.685139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:54:55.686356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:54:55.686356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:54:55.686356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:54:55.686356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e0f3c062-35ae-426e-bb26-695869ec48b5 is already attached to instances: 241a08df-4027-4153-8284-9ef744c15cb5 Aug 26 15:54:55.686356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:54:55.686356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-185f70bd-4000-4c32-95c0-237bc78fe9f0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Returning 400 to user: Invalid volume: volume e0f3c062-35ae-426e-bb26-695869ec48b5 is already attached to instances: 241a08df-4027-4153-8284-9ef744c15cb5 {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:54:55.686356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-185f70bd-4000-4c32-95c0-237bc78fe9f0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "POST /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110900 Aug 26 15:54:55.686356 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 280/562] 10.222.0.98 () {60 vars in 1323 bytes} [Fri Aug 26 15:54:55 2022] POST /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 15:54:55.692588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a9794d7e-f7f9-4787-9a36-ca30db8ad795 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:55.693093 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a9794d7e-f7f9-4787-9a36-ca30db8ad795 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:55.699644 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a9794d7e-f7f9-4787-9a36-ca30db8ad795 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:55.700166 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a9794d7e-f7f9-4787-9a36-ca30db8ad795 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:55.700785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a9794d7e-f7f9-4787-9a36-ca30db8ad795 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:55.701503 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a9794d7e-f7f9-4787-9a36-ca30db8ad795 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:55.701958 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a9794d7e-f7f9-4787-9a36-ca30db8ad795 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:55.702384 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a9794d7e-f7f9-4787-9a36-ca30db8ad795 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:55.734888 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a9794d7e-f7f9-4787-9a36-ca30db8ad795 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Going to try to terminate instance {{(pid=127697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:54:55.925872 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b69abfc9-e649-4e7e-9308-0a524cdaf0a3 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:55.926507 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b69abfc9-e649-4e7e-9308-0a524cdaf0a3 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:55.933177 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b69abfc9-e649-4e7e-9308-0a524cdaf0a3 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:55.933763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b69abfc9-e649-4e7e-9308-0a524cdaf0a3 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:55.934122 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b69abfc9-e649-4e7e-9308-0a524cdaf0a3 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:55.934805 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b69abfc9-e649-4e7e-9308-0a524cdaf0a3 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:55.935254 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b69abfc9-e649-4e7e-9308-0a524cdaf0a3 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:55.935675 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b69abfc9-e649-4e7e-9308-0a524cdaf0a3 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:55.980077 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a9794d7e-f7f9-4787-9a36-ca30db8ad795 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 204 len: 0 microversion: 2.1 time: 0.291638 Aug 26 15:54:55.980936 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 283/563] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:54:55 2022] DELETE /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:54:55.989616 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9cbbd87f-774d-4bfd-af46-e43414460df9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:55.990308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9cbbd87f-774d-4bfd-af46-e43414460df9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:55.996264 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9cbbd87f-774d-4bfd-af46-e43414460df9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:55.996745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9cbbd87f-774d-4bfd-af46-e43414460df9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:55.997176 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9cbbd87f-774d-4bfd-af46-e43414460df9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:55.997865 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9cbbd87f-774d-4bfd-af46-e43414460df9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:55.998311 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9cbbd87f-774d-4bfd-af46-e43414460df9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:55.998726 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9cbbd87f-774d-4bfd-af46-e43414460df9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:56.102231 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-b69abfc9-e649-4e7e-9308-0a524cdaf0a3 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:56.110824 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-b69abfc9-e649-4e7e-9308-0a524cdaf0a3 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1318 microversion: 2.1 time: 0.188779 Aug 26 15:54:56.111425 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 281/564] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:55 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:54:56.143023 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9cbbd87f-774d-4bfd-af46-e43414460df9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:56.151107 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9cbbd87f-774d-4bfd-af46-e43414460df9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1682 microversion: 2.1 time: 0.165594 Aug 26 15:54:56.151680 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 284/565] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:55 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:54:56.346849 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1123362c-9ac7-4bd7-8f2b-34599597cfe8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:56.348006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-1123362c-9ac7-4bd7-8f2b-34599597cfe8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:56.354449 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1123362c-9ac7-4bd7-8f2b-34599597cfe8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:56.354929 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1123362c-9ac7-4bd7-8f2b-34599597cfe8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:56.355366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1123362c-9ac7-4bd7-8f2b-34599597cfe8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:56.356092 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1123362c-9ac7-4bd7-8f2b-34599597cfe8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:56.356545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1123362c-9ac7-4bd7-8f2b-34599597cfe8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:56.356962 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1123362c-9ac7-4bd7-8f2b-34599597cfe8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:56.490344 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1123362c-9ac7-4bd7-8f2b-34599597cfe8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:56.498165 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-1123362c-9ac7-4bd7-8f2b-34599597cfe8 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1363 microversion: 2.1 time: 0.155146 Aug 26 15:54:56.498737 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 282/566] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:56 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:56.940269 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-2bac6b71-6f66-470a-9c9f-3914da5755b6 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-561218189"}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:56.940813 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-2bac6b71-6f66-470a-9c9f-3914da5755b6 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:56.948086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bac6b71-6f66-470a-9c9f-3914da5755b6 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:56.948614 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bac6b71-6f66-470a-9c9f-3914da5755b6 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:56.949096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bac6b71-6f66-470a-9c9f-3914da5755b6 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:56.949728 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bac6b71-6f66-470a-9c9f-3914da5755b6 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:56.950189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bac6b71-6f66-470a-9c9f-3914da5755b6 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:56.950610 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bac6b71-6f66-470a-9c9f-3914da5755b6 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:57.081741 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.network.security_group_api [None req-2bac6b71-6f66-470a-9c9f-3914da5755b6 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Adding security group 0a2777e4-d9b3-4372-b251-565fb8eb4870 to port c3463a69-702b-4594-8fcf-701aaf1b3696 Aug 26 15:54:57.132335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f669d493-93a0-45e8-9cc3-c263a9aa2b44 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:57.141304 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f669d493-93a0-45e8-9cc3-c263a9aa2b44 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:57.141304 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f669d493-93a0-45e8-9cc3-c263a9aa2b44 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:57.141304 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f669d493-93a0-45e8-9cc3-c263a9aa2b44 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:57.141304 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f669d493-93a0-45e8-9cc3-c263a9aa2b44 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:57.141698 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f669d493-93a0-45e8-9cc3-c263a9aa2b44 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:57.141698 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f669d493-93a0-45e8-9cc3-c263a9aa2b44 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:57.141698 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f669d493-93a0-45e8-9cc3-c263a9aa2b44 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:57.276090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f669d493-93a0-45e8-9cc3-c263a9aa2b44 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:57.284114 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f669d493-93a0-45e8-9cc3-c263a9aa2b44 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1507 microversion: 2.1 time: 0.155885 Aug 26 15:54:57.284935 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 283/567] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:57 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:54:57.289196 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ae8f2ad2-fb69-4250-b89c-6d78e6625466 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:57.289804 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ae8f2ad2-fb69-4250-b89c-6d78e6625466 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:57.295574 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae8f2ad2-fb69-4250-b89c-6d78e6625466 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:57.296097 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae8f2ad2-fb69-4250-b89c-6d78e6625466 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:57.296543 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae8f2ad2-fb69-4250-b89c-6d78e6625466 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:57.297219 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae8f2ad2-fb69-4250-b89c-6d78e6625466 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:57.297667 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae8f2ad2-fb69-4250-b89c-6d78e6625466 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:57.298086 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae8f2ad2-fb69-4250-b89c-6d78e6625466 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:57.438740 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ae8f2ad2-fb69-4250-b89c-6d78e6625466 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:57.442931 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=100 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:57.447826 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ae8f2ad2-fb69-4250-b89c-6d78e6625466 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1682 microversion: 2.1 time: 0.162268 Aug 26 15:54:57.448413 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 284/568] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:57 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:57.453123 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-bfa64ea5-d154-4d22-abd9-88841f1b6f6c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba63c45e-c00f-4ce3-a93f-daba2fafc2c1", "device": "/dev/sdb"}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:57.455537 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-bfa64ea5-d154-4d22-abd9-88841f1b6f6c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:57.461366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bfa64ea5-d154-4d22-abd9-88841f1b6f6c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:57.461846 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bfa64ea5-d154-4d22-abd9-88841f1b6f6c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:57.462280 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bfa64ea5-d154-4d22-abd9-88841f1b6f6c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:57.462962 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bfa64ea5-d154-4d22-abd9-88841f1b6f6c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:57.463409 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bfa64ea5-d154-4d22-abd9-88841f1b6f6c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:57.463828 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bfa64ea5-d154-4d22-abd9-88841f1b6f6c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:57.491433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-2bac6b71-6f66-470a-9c9f-3914da5755b6 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "POST /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/action" status: 202 len: 0 microversion: 2.1 time: 0.546155 Aug 26 15:54:57.491433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 285/569] 10.222.0.98 () {60 vars in 1278 bytes} [Fri Aug 26 15:54:56 2022] POST /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:54:57.491829 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-fb9a044d-602f-4a64-a0a9-d02a19d8acd4 req-6d7a8859-2fab-45b1-add5-65571c798927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe4d635-4211-49a0-99c5-aa69824b0de6", "tag": "c3463a69-702b-4594-8fcf-701aaf1b3696"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:54:57.502731 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-fb9a044d-602f-4a64-a0a9-d02a19d8acd4 req-6d7a8859-2fab-45b1-add5-65571c798927 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:57.503327 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-fb9a044d-602f-4a64-a0a9-d02a19d8acd4 req-6d7a8859-2fab-45b1-add5-65571c798927 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:57.504647 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-fb9a044d-602f-4a64-a0a9-d02a19d8acd4 req-6d7a8859-2fab-45b1-add5-65571c798927 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:57.525630 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-fb9a044d-602f-4a64-a0a9-d02a19d8acd4 req-6d7a8859-2fab-45b1-add5-65571c798927 service nova] Creating event network-changed:c3463a69-702b-4594-8fcf-701aaf1b3696 for instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 on hv-cinder-83124 Aug 26 15:54:57.532268 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-fb9a044d-602f-4a64-a0a9-d02a19d8acd4 req-6d7a8859-2fab-45b1-add5-65571c798927 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045270 Aug 26 15:54:57.533062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 286/570] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:57.541273 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f2e867da-caf3-4b3d-88ba-53064768ba9e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:57.542713 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f2e867da-caf3-4b3d-88ba-53064768ba9e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:57.551929 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f2e867da-caf3-4b3d-88ba-53064768ba9e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:57.552575 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f2e867da-caf3-4b3d-88ba-53064768ba9e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:57.553194 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f2e867da-caf3-4b3d-88ba-53064768ba9e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:57.554148 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f2e867da-caf3-4b3d-88ba-53064768ba9e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:57.554484 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f2e867da-caf3-4b3d-88ba-53064768ba9e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:57.554931 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f2e867da-caf3-4b3d-88ba-53064768ba9e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:57.704492 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f2e867da-caf3-4b3d-88ba-53064768ba9e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:57.713050 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f2e867da-caf3-4b3d-88ba-53064768ba9e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1759 microversion: 2.1 time: 0.178544 Aug 26 15:54:57.713637 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 287/571] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:57 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1759 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:57.718268 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9029c4ea-a31d-4a27-9be0-53153bf10fb1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:57.718812 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9029c4ea-a31d-4a27-9be0-53153bf10fb1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:57.720745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:57.725887 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9029c4ea-a31d-4a27-9be0-53153bf10fb1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:57.726372 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9029c4ea-a31d-4a27-9be0-53153bf10fb1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:57.726805 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9029c4ea-a31d-4a27-9be0-53153bf10fb1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:57.727501 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9029c4ea-a31d-4a27-9be0-53153bf10fb1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:57.727971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9029c4ea-a31d-4a27-9be0-53153bf10fb1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:57.728545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9029c4ea-a31d-4a27-9be0-53153bf10fb1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:57.861409 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9029c4ea-a31d-4a27-9be0-53153bf10fb1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:57.869874 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9029c4ea-a31d-4a27-9be0-53153bf10fb1 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1363 microversion: 2.1 time: 0.155236 Aug 26 15:54:57.870456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 288/572] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:57 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:58.469043 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-3b8601cc-0916-46a4-bfef-fe23cb6be64c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:58.469659 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-3b8601cc-0916-46a4-bfef-fe23cb6be64c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:58.476913 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3b8601cc-0916-46a4-bfef-fe23cb6be64c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:58.477388 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3b8601cc-0916-46a4-bfef-fe23cb6be64c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:58.477843 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3b8601cc-0916-46a4-bfef-fe23cb6be64c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:58.478533 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3b8601cc-0916-46a4-bfef-fe23cb6be64c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:58.478977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3b8601cc-0916-46a4-bfef-fe23cb6be64c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:58.479390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3b8601cc-0916-46a4-bfef-fe23cb6be64c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:58.614537 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-3b8601cc-0916-46a4-bfef-fe23cb6be64c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:58.622245 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-3b8601cc-0916-46a4-bfef-fe23cb6be64c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1682 microversion: 2.1 time: 0.157560 Aug 26 15:54:58.622804 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 289/573] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:58 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:54:58.890999 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-07b66aaf-df8f-4581-aabe-99c42514cc72 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:58.891518 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-07b66aaf-df8f-4581-aabe-99c42514cc72 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:58.898037 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07b66aaf-df8f-4581-aabe-99c42514cc72 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:58.898511 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07b66aaf-df8f-4581-aabe-99c42514cc72 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:58.898940 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07b66aaf-df8f-4581-aabe-99c42514cc72 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:58.899648 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07b66aaf-df8f-4581-aabe-99c42514cc72 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:58.900123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07b66aaf-df8f-4581-aabe-99c42514cc72 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:58.900573 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07b66aaf-df8f-4581-aabe-99c42514cc72 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:59.030019 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-07b66aaf-df8f-4581-aabe-99c42514cc72 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:59.038178 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-07b66aaf-df8f-4581-aabe-99c42514cc72 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1363 microversion: 2.1 time: 0.151187 Aug 26 15:54:59.038739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 290/574] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:58 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:54:59.437109 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=10 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:59.643936 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-8c006664-46df-4c4e-9265-9699762a1690 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:59.645094 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-8c006664-46df-4c4e-9265-9699762a1690 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:54:59.646907 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:59.647577 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=12 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:59.652900 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8c006664-46df-4c4e-9265-9699762a1690 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:59.653427 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8c006664-46df-4c4e-9265-9699762a1690 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:59.655347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8c006664-46df-4c4e-9265-9699762a1690 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:59.656551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8c006664-46df-4c4e-9265-9699762a1690 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:59.657347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8c006664-46df-4c4e-9265-9699762a1690 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:59.658143 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8c006664-46df-4c4e-9265-9699762a1690 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:59.860143 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-8c006664-46df-4c4e-9265-9699762a1690 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:54:59.866667 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:59.870380 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-8c006664-46df-4c4e-9265-9699762a1690 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1682 microversion: 2.1 time: 0.230325 Aug 26 15:54:59.887142 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 291/575] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:54:59 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1682 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:00.060981 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-02e1bc13-5cd9-4dea-ba29-70c15d0783c7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:00.061988 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-02e1bc13-5cd9-4dea-ba29-70c15d0783c7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:00.078984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-02e1bc13-5cd9-4dea-ba29-70c15d0783c7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:00.079733 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-02e1bc13-5cd9-4dea-ba29-70c15d0783c7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:00.080478 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-02e1bc13-5cd9-4dea-ba29-70c15d0783c7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:00.081497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-02e1bc13-5cd9-4dea-ba29-70c15d0783c7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:00.082161 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-02e1bc13-5cd9-4dea-ba29-70c15d0783c7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:00.082818 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-02e1bc13-5cd9-4dea-ba29-70c15d0783c7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:00.230644 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-02e1bc13-5cd9-4dea-ba29-70c15d0783c7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:00.238807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-02e1bc13-5cd9-4dea-ba29-70c15d0783c7 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1363 microversion: 2.1 time: 0.182095 Aug 26 15:55:00.239416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 292/576] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:00 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:00.344132 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-bfa64ea5-d154-4d22-abd9-88841f1b6f6c tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "POST /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.894468 Aug 26 15:55:00.344751 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 285/577] 10.222.0.98 () {60 vars in 1323 bytes} [Fri Aug 26 15:54:57 2022] POST /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13/os-volume_attachments => generated 194 bytes in 2896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:00.634861 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-e88bc261-6096-49b6-acb8-b3cfc0694f4a req-68468ee2-04d0-4505-89f5-98304a113763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af463f4-5ec2-4134-81cf-bd9adfc4853f", "name": "network-vif-deleted", "tag": "539f60bc-cce0-48d0-b6bc-2e857f41b14d"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:00.648336 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-e88bc261-6096-49b6-acb8-b3cfc0694f4a req-68468ee2-04d0-4505-89f5-98304a113763 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:00.649024 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-e88bc261-6096-49b6-acb8-b3cfc0694f4a req-68468ee2-04d0-4505-89f5-98304a113763 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:00.649285 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-e88bc261-6096-49b6-acb8-b3cfc0694f4a req-68468ee2-04d0-4505-89f5-98304a113763 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:00.663039 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-e88bc261-6096-49b6-acb8-b3cfc0694f4a req-68468ee2-04d0-4505-89f5-98304a113763 service nova] Creating event network-vif-deleted:539f60bc-cce0-48d0-b6bc-2e857f41b14d for instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f on hv-cinder-83124 Aug 26 15:55:00.668002 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-e88bc261-6096-49b6-acb8-b3cfc0694f4a req-68468ee2-04d0-4505-89f5-98304a113763 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037169 Aug 26 15:55:00.668608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 293/578] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:00.895815 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e19c585b-d7e8-4054-9137-be43e6953447 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:00.896458 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e19c585b-d7e8-4054-9137-be43e6953447 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:00.902724 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e19c585b-d7e8-4054-9137-be43e6953447 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:00.903211 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e19c585b-d7e8-4054-9137-be43e6953447 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:00.903644 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e19c585b-d7e8-4054-9137-be43e6953447 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:00.904370 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e19c585b-d7e8-4054-9137-be43e6953447 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:00.904813 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e19c585b-d7e8-4054-9137-be43e6953447 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:00.905230 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e19c585b-d7e8-4054-9137-be43e6953447 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:00.974495 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e19c585b-d7e8-4054-9137-be43e6953447 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:00.982459 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e19c585b-d7e8-4054-9137-be43e6953447 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1327 microversion: 2.1 time: 0.091541 Aug 26 15:55:00.983042 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 286/579] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:00 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1327 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:01.261928 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-06339874-1b22-418c-9401-36abc9c5b4fe tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:01.263925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-06339874-1b22-418c-9401-36abc9c5b4fe tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:01.271532 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06339874-1b22-418c-9401-36abc9c5b4fe tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:01.272221 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06339874-1b22-418c-9401-36abc9c5b4fe tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:01.272896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06339874-1b22-418c-9401-36abc9c5b4fe tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:01.273924 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06339874-1b22-418c-9401-36abc9c5b4fe tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:01.274391 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06339874-1b22-418c-9401-36abc9c5b4fe tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:01.274826 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-06339874-1b22-418c-9401-36abc9c5b4fe tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:01.461870 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-06339874-1b22-418c-9401-36abc9c5b4fe tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:01.468792 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-06339874-1b22-418c-9401-36abc9c5b4fe tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1363 microversion: 2.1 time: 0.212744 Aug 26 15:55:01.469899 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 294/580] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:01 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:02.005348 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-9419260b-6c7f-4fe7-be01-e84cb0a2e1ed tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:02.007367 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-9419260b-6c7f-4fe7-be01-e84cb0a2e1ed tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:02.015810 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9419260b-6c7f-4fe7-be01-e84cb0a2e1ed tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:02.016437 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9419260b-6c7f-4fe7-be01-e84cb0a2e1ed tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:02.016940 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9419260b-6c7f-4fe7-be01-e84cb0a2e1ed tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:02.017809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9419260b-6c7f-4fe7-be01-e84cb0a2e1ed tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:02.018452 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9419260b-6c7f-4fe7-be01-e84cb0a2e1ed tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:02.018946 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9419260b-6c7f-4fe7-be01-e84cb0a2e1ed tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:02.050172 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9419260b-6c7f-4fe7-be01-e84cb0a2e1ed tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:02.051196 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9419260b-6c7f-4fe7-be01-e84cb0a2e1ed tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:02.051629 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9419260b-6c7f-4fe7-be01-e84cb0a2e1ed tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:02.052106 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-9419260b-6c7f-4fe7-be01-e84cb0a2e1ed tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lazy-loading 'fault' on Instance uuid 9af463f4-5ec2-4134-81cf-bd9adfc4853f {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:55:02.092727 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-9419260b-6c7f-4fe7-be01-e84cb0a2e1ed tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:02.100724 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-9419260b-6c7f-4fe7-be01-e84cb0a2e1ed tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 200 len: 1332 microversion: 2.1 time: 0.099958 Aug 26 15:55:02.101296 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 287/581] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:01 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:02.491444 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-68272733-802f-4350-9020-6af48ce16572 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:02.492102 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-68272733-802f-4350-9020-6af48ce16572 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:02.499632 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-68272733-802f-4350-9020-6af48ce16572 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:02.500158 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-68272733-802f-4350-9020-6af48ce16572 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:02.500596 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-68272733-802f-4350-9020-6af48ce16572 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:02.501295 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-68272733-802f-4350-9020-6af48ce16572 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:02.501784 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-68272733-802f-4350-9020-6af48ce16572 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:02.502219 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-68272733-802f-4350-9020-6af48ce16572 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:02.861010 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-68272733-802f-4350-9020-6af48ce16572 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:02.871233 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-68272733-802f-4350-9020-6af48ce16572 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1363 microversion: 2.1 time: 0.384698 Aug 26 15:55:02.871788 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 295/582] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:02 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:03.122764 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-91925c1d-5030-47f0-9379-bdb6bd89cce0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:03.123305 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-91925c1d-5030-47f0-9379-bdb6bd89cce0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:03.129686 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91925c1d-5030-47f0-9379-bdb6bd89cce0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:03.130163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91925c1d-5030-47f0-9379-bdb6bd89cce0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:03.130593 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91925c1d-5030-47f0-9379-bdb6bd89cce0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:03.131279 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91925c1d-5030-47f0-9379-bdb6bd89cce0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:03.131727 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91925c1d-5030-47f0-9379-bdb6bd89cce0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:03.132174 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91925c1d-5030-47f0-9379-bdb6bd89cce0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:03.145360 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-91925c1d-5030-47f0-9379-bdb6bd89cce0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] HTTP exception thrown: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-91925c1d-5030-47f0-9379-bdb6bd89cce0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Request method failure captured: Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f HTTP/1.1 Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOwce1DELhS8UmzpwnI-HX_EQrzE1_2dLaZIAb4DQQsaHzNq-4kKoCdv0aDJeKx2SvQqLHnYNV9XirCc5SAbojp-C1CHsa7OjA6o0rOrx5rLneplb_EX2pmB01iYBvFpO8o6110oFO2yAC5E6SvWdsfGmZrZ7TZSaR32s4VudVlpurQ Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:55:03.147002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:55:03.148535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f40d6476c750438c9c09107c7757fa95", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}] Aug 26 15:55:03.148535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:55:03.148535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:55:03.148535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:55:03.148535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:55:03.148535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:55:03.148535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:55:03.148535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 9348310fd06b473786d1c6be4f20c481 Aug 26 15:55:03.148535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:55:03.148535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:55:03.148535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. Aug 26 15:55:03.148535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '9af463f4-5ec2-4134-81cf-bd9adfc4853f'} Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:55:03.149492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. Aug 26 15:55:03.150987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:03.152492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-91925c1d-5030-47f0-9379-bdb6bd89cce0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Returning 404 to user: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:55:03.152492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-91925c1d-5030-47f0-9379-bdb6bd89cce0 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 404 len: 111 microversion: 2.1 time: 0.029751 Aug 26 15:55:03.152492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 288/583] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:03 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:55:03.157463 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d2edd4cd-92f8-4676-b782-fd548cd37840 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '.version_select at 0x7fbd1e2d8af0>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:03.261119 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d2edd4cd-92f8-4676-b782-fd548cd37840 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712514585" status: 202 len: 0 microversion: 2.1 time: 0.107311 Aug 26 15:55:03.261642 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 296/584] 10.222.0.98 () {58 vars in 1221 bytes} [Fri Aug 26 15:55:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712514585 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:55:03.891098 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-394ab679-3f0f-440a-b3fd-33305d143243 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:03.891711 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-394ab679-3f0f-440a-b3fd-33305d143243 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:03.897931 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-394ab679-3f0f-440a-b3fd-33305d143243 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:03.900400 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-394ab679-3f0f-440a-b3fd-33305d143243 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:03.900400 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-394ab679-3f0f-440a-b3fd-33305d143243 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:03.900400 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-394ab679-3f0f-440a-b3fd-33305d143243 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:03.900400 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-394ab679-3f0f-440a-b3fd-33305d143243 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:03.900948 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-394ab679-3f0f-440a-b3fd-33305d143243 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:04.051610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-394ab679-3f0f-440a-b3fd-33305d143243 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:04.059374 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-394ab679-3f0f-440a-b3fd-33305d143243 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1363 microversion: 2.1 time: 0.172167 Aug 26 15:55:04.059967 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 289/585] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:03 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:04.084261 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-dad5b705-3a8f-47ce-9e4d-74e811cb3a0e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:04.084868 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-dad5b705-3a8f-47ce-9e4d-74e811cb3a0e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:04.091810 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dad5b705-3a8f-47ce-9e4d-74e811cb3a0e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:04.092319 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dad5b705-3a8f-47ce-9e4d-74e811cb3a0e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:04.092749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dad5b705-3a8f-47ce-9e4d-74e811cb3a0e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:04.093437 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dad5b705-3a8f-47ce-9e4d-74e811cb3a0e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:04.093890 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dad5b705-3a8f-47ce-9e4d-74e811cb3a0e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:04.094313 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dad5b705-3a8f-47ce-9e4d-74e811cb3a0e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:04.224683 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-dad5b705-3a8f-47ce-9e4d-74e811cb3a0e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lazy-loading 'services' on Instance uuid 241a08df-4027-4153-8284-9ef744c15cb5 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:55:04.249659 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-51e68d27-ea43-4460-b7ae-2613f13832a4 req-03a3ef39-446e-485f-a125-a2fdf2a48451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0a2d2ae-7ca7-4e36-8a70-14dc24125e00", "name": "network-vif-plugged", "status": "completed", "tag": "9b82b23b-877d-4880-a87b-652c8b6c2ae6"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:04.261048 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-51e68d27-ea43-4460-b7ae-2613f13832a4 req-03a3ef39-446e-485f-a125-a2fdf2a48451 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:04.261614 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-51e68d27-ea43-4460-b7ae-2613f13832a4 req-03a3ef39-446e-485f-a125-a2fdf2a48451 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:04.262110 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-51e68d27-ea43-4460-b7ae-2613f13832a4 req-03a3ef39-446e-485f-a125-a2fdf2a48451 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:04.275494 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-51e68d27-ea43-4460-b7ae-2613f13832a4 req-03a3ef39-446e-485f-a125-a2fdf2a48451 service nova] Creating event network-vif-plugged:9b82b23b-877d-4880-a87b-652c8b6c2ae6 for instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 on hv-cinder-83124 Aug 26 15:55:04.280566 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-51e68d27-ea43-4460-b7ae-2613f13832a4 req-03a3ef39-446e-485f-a125-a2fdf2a48451 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035800 Aug 26 15:55:04.282389 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 290/586] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:55:04.470677 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5f91dd74-adec-4826-9e25-7dbcce7c6c2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:04.471231 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5f91dd74-adec-4826-9e25-7dbcce7c6c2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:04.478109 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f91dd74-adec-4826-9e25-7dbcce7c6c2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:04.482639 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f91dd74-adec-4826-9e25-7dbcce7c6c2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:04.482639 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f91dd74-adec-4826-9e25-7dbcce7c6c2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:04.482639 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f91dd74-adec-4826-9e25-7dbcce7c6c2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:04.482639 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f91dd74-adec-4826-9e25-7dbcce7c6c2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:04.483027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f91dd74-adec-4826-9e25-7dbcce7c6c2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:04.485843 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-dad5b705-3a8f-47ce-9e4d-74e811cb3a0e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "DELETE /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments/e0f3c062-35ae-426e-bb26-695869ec48b5" status: 202 len: 0 microversion: 2.1 time: 0.405928 Aug 26 15:55:04.486575 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 297/587] 10.222.0.98 () {58 vars in 1416 bytes} [Fri Aug 26 15:55:04 2022] DELETE /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments/e0f3c062-35ae-426e-bb26-695869ec48b5 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:55:04.496025 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b1e3cdef-12e4-4c75-ac85-16f845261070 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:04.498567 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b1e3cdef-12e4-4c75-ac85-16f845261070 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:04.505186 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b1e3cdef-12e4-4c75-ac85-16f845261070 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:04.505683 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b1e3cdef-12e4-4c75-ac85-16f845261070 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:04.506124 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b1e3cdef-12e4-4c75-ac85-16f845261070 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:04.506832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b1e3cdef-12e4-4c75-ac85-16f845261070 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:04.507318 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b1e3cdef-12e4-4c75-ac85-16f845261070 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:04.507766 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b1e3cdef-12e4-4c75-ac85-16f845261070 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:04.540553 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b1e3cdef-12e4-4c75-ac85-16f845261070 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048758 Aug 26 15:55:04.541311 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 298/588] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:04 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:55:04.577130 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-5f91dd74-adec-4826-9e25-7dbcce7c6c2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lazy-loading 'services' on Instance uuid 08d976c8-85c3-48de-80ba-93fdff79445a {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:55:04.834456 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5f91dd74-adec-4826-9e25-7dbcce7c6c2f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "DELETE /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments/1145727f-9298-496b-955c-b995f6c62dfe" status: 202 len: 0 microversion: 2.1 time: 0.368164 Aug 26 15:55:04.835055 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 291/589] 10.222.0.98 () {58 vars in 1416 bytes} [Fri Aug 26 15:55:04 2022] DELETE /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments/1145727f-9298-496b-955c-b995f6c62dfe => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 15:55:04.844134 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-8ab79c48-3452-45cc-9458-1330b2f22cba tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:04.846243 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-8ab79c48-3452-45cc-9458-1330b2f22cba tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:04.852465 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8ab79c48-3452-45cc-9458-1330b2f22cba tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:04.852948 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8ab79c48-3452-45cc-9458-1330b2f22cba tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:04.853383 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8ab79c48-3452-45cc-9458-1330b2f22cba tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:04.854071 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8ab79c48-3452-45cc-9458-1330b2f22cba tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:04.854521 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8ab79c48-3452-45cc-9458-1330b2f22cba tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:04.854943 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8ab79c48-3452-45cc-9458-1330b2f22cba tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:04.887150 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-8ab79c48-3452-45cc-9458-1330b2f22cba tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047237 Aug 26 15:55:04.887743 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 299/590] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:04 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:05.081115 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7ea720af-687e-4251-9655-6234e5bc2570 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:05.081727 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7ea720af-687e-4251-9655-6234e5bc2570 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:05.087938 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ea720af-687e-4251-9655-6234e5bc2570 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:05.088431 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ea720af-687e-4251-9655-6234e5bc2570 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:05.088871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ea720af-687e-4251-9655-6234e5bc2570 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:05.089561 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ea720af-687e-4251-9655-6234e5bc2570 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:05.090015 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ea720af-687e-4251-9655-6234e5bc2570 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:05.090440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ea720af-687e-4251-9655-6234e5bc2570 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:05.225234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7ea720af-687e-4251-9655-6234e5bc2570 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:05.233025 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7ea720af-687e-4251-9655-6234e5bc2570 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1363 microversion: 2.1 time: 0.156269 Aug 26 15:55:05.233591 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 292/591] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:05 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:05.553871 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-62e0d353-6f73-4938-b915-b7a5734edeb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:05.556022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-62e0d353-6f73-4938-b915-b7a5734edeb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:05.562333 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-62e0d353-6f73-4938-b915-b7a5734edeb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:05.562806 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-62e0d353-6f73-4938-b915-b7a5734edeb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:05.563233 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-62e0d353-6f73-4938-b915-b7a5734edeb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:05.563942 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-62e0d353-6f73-4938-b915-b7a5734edeb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:05.564390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-62e0d353-6f73-4938-b915-b7a5734edeb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:05.564812 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-62e0d353-6f73-4938-b915-b7a5734edeb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:05.595263 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-62e0d353-6f73-4938-b915-b7a5734edeb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045889 Aug 26 15:55:05.595817 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 300/592] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:05 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:05.899394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-423d009e-3973-40d9-a758-5feaae125118 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:05.901788 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-423d009e-3973-40d9-a758-5feaae125118 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:05.908512 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-423d009e-3973-40d9-a758-5feaae125118 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:05.909007 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-423d009e-3973-40d9-a758-5feaae125118 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:05.909551 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-423d009e-3973-40d9-a758-5feaae125118 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:05.910866 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-423d009e-3973-40d9-a758-5feaae125118 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:05.911323 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-423d009e-3973-40d9-a758-5feaae125118 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:05.911744 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-423d009e-3973-40d9-a758-5feaae125118 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:05.943180 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-423d009e-3973-40d9-a758-5feaae125118 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047787 Aug 26 15:55:05.943684 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 293/593] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:05 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:06.254242 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-345f56fb-f0e4-429c-9ab5-1befe10ef364 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:06.254746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-345f56fb-f0e4-429c-9ab5-1befe10ef364 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:06.260714 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-345f56fb-f0e4-429c-9ab5-1befe10ef364 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:06.261782 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-345f56fb-f0e4-429c-9ab5-1befe10ef364 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:06.262328 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-345f56fb-f0e4-429c-9ab5-1befe10ef364 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:06.263017 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-345f56fb-f0e4-429c-9ab5-1befe10ef364 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:06.263467 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-345f56fb-f0e4-429c-9ab5-1befe10ef364 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:06.263901 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-345f56fb-f0e4-429c-9ab5-1befe10ef364 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:06.510977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-345f56fb-f0e4-429c-9ab5-1befe10ef364 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:06.518812 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-345f56fb-f0e4-429c-9ab5-1befe10ef364 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1363 microversion: 2.1 time: 0.269046 Aug 26 15:55:06.520528 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 301/594] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:06 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:06.607743 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3e9abfe7-7083-427c-a9cd-d0422ec1d06b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:06.609886 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3e9abfe7-7083-427c-a9cd-d0422ec1d06b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:06.616172 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3e9abfe7-7083-427c-a9cd-d0422ec1d06b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:06.616652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3e9abfe7-7083-427c-a9cd-d0422ec1d06b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:06.617083 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3e9abfe7-7083-427c-a9cd-d0422ec1d06b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:06.617776 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3e9abfe7-7083-427c-a9cd-d0422ec1d06b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:06.618217 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3e9abfe7-7083-427c-a9cd-d0422ec1d06b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:06.618645 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3e9abfe7-7083-427c-a9cd-d0422ec1d06b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:06.649761 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3e9abfe7-7083-427c-a9cd-d0422ec1d06b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045936 Aug 26 15:55:06.650331 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 294/595] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:06 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:06.955772 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9e338a1e-745c-41e4-8a5d-7cd7990eafe4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:06.958068 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9e338a1e-745c-41e4-8a5d-7cd7990eafe4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:06.964512 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9e338a1e-745c-41e4-8a5d-7cd7990eafe4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:06.964986 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9e338a1e-745c-41e4-8a5d-7cd7990eafe4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:06.965417 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9e338a1e-745c-41e4-8a5d-7cd7990eafe4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:06.966136 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9e338a1e-745c-41e4-8a5d-7cd7990eafe4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:06.966577 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9e338a1e-745c-41e4-8a5d-7cd7990eafe4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:06.966994 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9e338a1e-745c-41e4-8a5d-7cd7990eafe4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:06.996449 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9e338a1e-745c-41e4-8a5d-7cd7990eafe4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Aug 26 15:55:06.997002 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 302/596] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:06 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:07.540778 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b81cf358-5028-4583-89d6-b5e24a2d832d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:07.541297 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b81cf358-5028-4583-89d6-b5e24a2d832d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:07.547850 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b81cf358-5028-4583-89d6-b5e24a2d832d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:07.548357 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b81cf358-5028-4583-89d6-b5e24a2d832d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:07.548798 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b81cf358-5028-4583-89d6-b5e24a2d832d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:07.549485 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b81cf358-5028-4583-89d6-b5e24a2d832d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:07.549932 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b81cf358-5028-4583-89d6-b5e24a2d832d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:07.550353 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b81cf358-5028-4583-89d6-b5e24a2d832d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:07.663988 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e340cc1b-f733-49c9-b7a2-064ba392a2a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:07.666960 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e340cc1b-f733-49c9-b7a2-064ba392a2a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:07.673540 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e340cc1b-f733-49c9-b7a2-064ba392a2a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:07.674027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e340cc1b-f733-49c9-b7a2-064ba392a2a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:07.674464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e340cc1b-f733-49c9-b7a2-064ba392a2a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:07.675340 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e340cc1b-f733-49c9-b7a2-064ba392a2a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:07.676439 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e340cc1b-f733-49c9-b7a2-064ba392a2a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:07.682783 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e340cc1b-f733-49c9-b7a2-064ba392a2a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:07.707712 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e340cc1b-f733-49c9-b7a2-064ba392a2a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049296 Aug 26 15:55:07.708355 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 303/597] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:07 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:07.736474 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-b81cf358-5028-4583-89d6-b5e24a2d832d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:07.745194 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-b81cf358-5028-4583-89d6-b5e24a2d832d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1549 microversion: 2.1 time: 0.208350 Aug 26 15:55:07.745796 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 295/598] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:07 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1549 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:07.765648 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d13451fb-124a-4b67-98cc-95f3ce4a7e34 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:07.766424 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d13451fb-124a-4b67-98cc-95f3ce4a7e34 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:07.773095 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d13451fb-124a-4b67-98cc-95f3ce4a7e34 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:07.773579 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d13451fb-124a-4b67-98cc-95f3ce4a7e34 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:07.774014 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d13451fb-124a-4b67-98cc-95f3ce4a7e34 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:07.774809 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d13451fb-124a-4b67-98cc-95f3ce4a7e34 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:07.775277 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d13451fb-124a-4b67-98cc-95f3ce4a7e34 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:07.775698 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d13451fb-124a-4b67-98cc-95f3ce4a7e34 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:07.861552 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d13451fb-124a-4b67-98cc-95f3ce4a7e34 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099810 Aug 26 15:55:07.862145 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 304/599] 10.222.0.98 () {58 vars in 1275 bytes} [Fri Aug 26 15:55:07 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:08.009203 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ed545dea-836d-4b94-8b54-4485969e5d77 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:08.011345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ed545dea-836d-4b94-8b54-4485969e5d77 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:08.017365 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed545dea-836d-4b94-8b54-4485969e5d77 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:08.017853 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed545dea-836d-4b94-8b54-4485969e5d77 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:08.018291 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed545dea-836d-4b94-8b54-4485969e5d77 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:08.018987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed545dea-836d-4b94-8b54-4485969e5d77 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:08.019973 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed545dea-836d-4b94-8b54-4485969e5d77 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:08.020402 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed545dea-836d-4b94-8b54-4485969e5d77 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:08.051129 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ed545dea-836d-4b94-8b54-4485969e5d77 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046050 Aug 26 15:55:08.051626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 296/600] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:08 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:08.720938 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-136aa029-88b5-488a-aef8-cc427047535c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:08.723033 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-136aa029-88b5-488a-aef8-cc427047535c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:08.729131 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-136aa029-88b5-488a-aef8-cc427047535c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:08.729632 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-136aa029-88b5-488a-aef8-cc427047535c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:08.730244 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-136aa029-88b5-488a-aef8-cc427047535c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:08.730949 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-136aa029-88b5-488a-aef8-cc427047535c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:08.731400 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-136aa029-88b5-488a-aef8-cc427047535c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:08.731822 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-136aa029-88b5-488a-aef8-cc427047535c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:08.764749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-136aa029-88b5-488a-aef8-cc427047535c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048543 Aug 26 15:55:08.765509 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 305/601] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:08 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:08.879420 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-f5a057af-d190-418f-8b6f-46702d07dfbd req-7814ba9f-205c-4b08-984e-fe70d0f5cb93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0a2d2ae-7ca7-4e36-8a70-14dc24125e00", "tag": "9b82b23b-877d-4880-a87b-652c8b6c2ae6"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:08.889229 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-f5a057af-d190-418f-8b6f-46702d07dfbd req-7814ba9f-205c-4b08-984e-fe70d0f5cb93 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:08.889706 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-f5a057af-d190-418f-8b6f-46702d07dfbd req-7814ba9f-205c-4b08-984e-fe70d0f5cb93 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:08.890138 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-f5a057af-d190-418f-8b6f-46702d07dfbd req-7814ba9f-205c-4b08-984e-fe70d0f5cb93 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:08.903027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-f5a057af-d190-418f-8b6f-46702d07dfbd req-7814ba9f-205c-4b08-984e-fe70d0f5cb93 service nova] Creating event network-changed:9b82b23b-877d-4880-a87b-652c8b6c2ae6 for instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 on hv-cinder-83124 Aug 26 15:55:08.908572 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-f5a057af-d190-418f-8b6f-46702d07dfbd req-7814ba9f-205c-4b08-984e-fe70d0f5cb93 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033188 Aug 26 15:55:08.912185 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 297/602] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:09.063086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d5dab595-771f-49cd-9c9c-2571f07d2761 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:09.065407 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d5dab595-771f-49cd-9c9c-2571f07d2761 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:09.071709 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d5dab595-771f-49cd-9c9c-2571f07d2761 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:09.072309 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d5dab595-771f-49cd-9c9c-2571f07d2761 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:09.078351 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d5dab595-771f-49cd-9c9c-2571f07d2761 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:09.078351 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d5dab595-771f-49cd-9c9c-2571f07d2761 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:09.078351 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d5dab595-771f-49cd-9c9c-2571f07d2761 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:09.078351 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d5dab595-771f-49cd-9c9c-2571f07d2761 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:09.105706 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d5dab595-771f-49cd-9c9c-2571f07d2761 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046755 Aug 26 15:55:09.110419 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 306/603] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:09 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:09.777507 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2984311b-2c03-4e6b-8304-662d4b361336 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:09.779726 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2984311b-2c03-4e6b-8304-662d4b361336 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:09.786113 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2984311b-2c03-4e6b-8304-662d4b361336 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:09.786590 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2984311b-2c03-4e6b-8304-662d4b361336 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:09.787019 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2984311b-2c03-4e6b-8304-662d4b361336 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:09.787715 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2984311b-2c03-4e6b-8304-662d4b361336 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:09.788200 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2984311b-2c03-4e6b-8304-662d4b361336 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:09.788823 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2984311b-2c03-4e6b-8304-662d4b361336 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:09.825382 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2984311b-2c03-4e6b-8304-662d4b361336 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052262 Aug 26 15:55:09.825972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 298/604] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:09 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:10.118727 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-3f53b4b0-496c-4181-9706-68c64941d0ac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:10.121173 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-3f53b4b0-496c-4181-9706-68c64941d0ac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:10.128213 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3f53b4b0-496c-4181-9706-68c64941d0ac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:10.128697 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3f53b4b0-496c-4181-9706-68c64941d0ac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:10.129761 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3f53b4b0-496c-4181-9706-68c64941d0ac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:10.130462 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3f53b4b0-496c-4181-9706-68c64941d0ac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:10.130942 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3f53b4b0-496c-4181-9706-68c64941d0ac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:10.131368 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3f53b4b0-496c-4181-9706-68c64941d0ac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:10.162593 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-3f53b4b0-496c-4181-9706-68c64941d0ac tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048140 Aug 26 15:55:10.163171 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 307/605] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:10 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:10.837835 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e65a47c7-bd08-4b6f-bec1-805cc71c0ec6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:10.840037 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e65a47c7-bd08-4b6f-bec1-805cc71c0ec6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:10.846888 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e65a47c7-bd08-4b6f-bec1-805cc71c0ec6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:10.847053 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e65a47c7-bd08-4b6f-bec1-805cc71c0ec6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:10.847481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e65a47c7-bd08-4b6f-bec1-805cc71c0ec6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:10.848344 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e65a47c7-bd08-4b6f-bec1-805cc71c0ec6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:10.848712 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e65a47c7-bd08-4b6f-bec1-805cc71c0ec6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:10.849146 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e65a47c7-bd08-4b6f-bec1-805cc71c0ec6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:10.880145 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e65a47c7-bd08-4b6f-bec1-805cc71c0ec6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046184 Aug 26 15:55:10.880717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 299/606] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:10 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:11.174996 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-cb538607-2444-4329-b98e-96db4b1caba8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:11.177681 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-cb538607-2444-4329-b98e-96db4b1caba8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:11.184373 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cb538607-2444-4329-b98e-96db4b1caba8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:11.184862 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cb538607-2444-4329-b98e-96db4b1caba8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:11.185302 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cb538607-2444-4329-b98e-96db4b1caba8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:11.186007 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cb538607-2444-4329-b98e-96db4b1caba8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:11.186479 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cb538607-2444-4329-b98e-96db4b1caba8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:11.186893 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cb538607-2444-4329-b98e-96db4b1caba8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:11.217150 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-cb538607-2444-4329-b98e-96db4b1caba8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046206 Aug 26 15:55:11.217716 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 308/607] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:11 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:11.892614 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d6eff7f3-66d6-4449-874d-257177f2b570 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:11.894839 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d6eff7f3-66d6-4449-874d-257177f2b570 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:11.901477 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d6eff7f3-66d6-4449-874d-257177f2b570 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:11.901987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d6eff7f3-66d6-4449-874d-257177f2b570 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:11.902427 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d6eff7f3-66d6-4449-874d-257177f2b570 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:11.903135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d6eff7f3-66d6-4449-874d-257177f2b570 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:11.903623 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d6eff7f3-66d6-4449-874d-257177f2b570 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:11.904082 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d6eff7f3-66d6-4449-874d-257177f2b570 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:11.936471 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d6eff7f3-66d6-4449-874d-257177f2b570 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047747 Aug 26 15:55:11.937042 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 300/608] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:11 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:12.229267 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1f40579c-81cd-4a9a-bf96-434fbcb50dce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:12.231437 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1f40579c-81cd-4a9a-bf96-434fbcb50dce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:12.238019 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f40579c-81cd-4a9a-bf96-434fbcb50dce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:12.238513 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f40579c-81cd-4a9a-bf96-434fbcb50dce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:12.238944 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f40579c-81cd-4a9a-bf96-434fbcb50dce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:12.239641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f40579c-81cd-4a9a-bf96-434fbcb50dce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:12.245414 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f40579c-81cd-4a9a-bf96-434fbcb50dce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:12.245414 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f40579c-81cd-4a9a-bf96-434fbcb50dce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:12.268252 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:55:12.273551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1f40579c-81cd-4a9a-bf96-434fbcb50dce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048324 Aug 26 15:55:12.274182 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 309/609] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:12 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:12.949585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3172479b-1728-477f-9a66-6124287bca24 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:12.951728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3172479b-1728-477f-9a66-6124287bca24 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:12.959059 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3172479b-1728-477f-9a66-6124287bca24 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:12.959532 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3172479b-1728-477f-9a66-6124287bca24 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:12.959991 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3172479b-1728-477f-9a66-6124287bca24 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:12.960751 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3172479b-1728-477f-9a66-6124287bca24 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:12.961197 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3172479b-1728-477f-9a66-6124287bca24 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:12.961627 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3172479b-1728-477f-9a66-6124287bca24 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:12.965614 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:55:12.993778 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3172479b-1728-477f-9a66-6124287bca24 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048515 Aug 26 15:55:12.994349 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 301/610] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:12 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:55:13.286440 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0cc0c577-0f40-439a-a023-1dd26fad0208 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:13.289272 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0cc0c577-0f40-439a-a023-1dd26fad0208 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:13.296739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0cc0c577-0f40-439a-a023-1dd26fad0208 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:13.297223 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0cc0c577-0f40-439a-a023-1dd26fad0208 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:13.297655 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0cc0c577-0f40-439a-a023-1dd26fad0208 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:13.298358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0cc0c577-0f40-439a-a023-1dd26fad0208 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:13.298858 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0cc0c577-0f40-439a-a023-1dd26fad0208 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:13.299267 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0cc0c577-0f40-439a-a023-1dd26fad0208 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:13.330391 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0cc0c577-0f40-439a-a023-1dd26fad0208 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048531 Aug 26 15:55:13.330956 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 310/611] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:13 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:55:14.005950 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c6581710-e231-46c2-9139-c354b1c5ca60 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:14.008128 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c6581710-e231-46c2-9139-c354b1c5ca60 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:14.015201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6581710-e231-46c2-9139-c354b1c5ca60 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:14.015732 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6581710-e231-46c2-9139-c354b1c5ca60 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:14.016185 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6581710-e231-46c2-9139-c354b1c5ca60 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:14.020821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6581710-e231-46c2-9139-c354b1c5ca60 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:14.020821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6581710-e231-46c2-9139-c354b1c5ca60 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:14.020821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6581710-e231-46c2-9139-c354b1c5ca60 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:14.048813 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c6581710-e231-46c2-9139-c354b1c5ca60 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046906 Aug 26 15:55:14.049527 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 302/612] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:14 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 15:55:14.117645 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-03dd7338-2478-4b6d-825f-2927252e7713 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:14.118139 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-03dd7338-2478-4b6d-825f-2927252e7713 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:14.124342 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-03dd7338-2478-4b6d-825f-2927252e7713 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:14.124828 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-03dd7338-2478-4b6d-825f-2927252e7713 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:14.125286 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-03dd7338-2478-4b6d-825f-2927252e7713 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:14.125961 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-03dd7338-2478-4b6d-825f-2927252e7713 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:14.126466 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-03dd7338-2478-4b6d-825f-2927252e7713 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:14.126890 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-03dd7338-2478-4b6d-825f-2927252e7713 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:14.153756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-03dd7338-2478-4b6d-825f-2927252e7713 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Going to try to terminate instance {{(pid=127697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:55:14.345456 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-350bc61d-f03d-4328-be61-1ca24f2e6b4a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:14.347655 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-350bc61d-f03d-4328-be61-1ca24f2e6b4a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:14.355559 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-350bc61d-f03d-4328-be61-1ca24f2e6b4a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:14.356089 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-350bc61d-f03d-4328-be61-1ca24f2e6b4a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:14.356526 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-350bc61d-f03d-4328-be61-1ca24f2e6b4a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:14.357228 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-350bc61d-f03d-4328-be61-1ca24f2e6b4a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:14.357683 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-350bc61d-f03d-4328-be61-1ca24f2e6b4a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:14.358107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-350bc61d-f03d-4328-be61-1ca24f2e6b4a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:14.393263 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-350bc61d-f03d-4328-be61-1ca24f2e6b4a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052738 Aug 26 15:55:14.393845 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 303/613] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:14 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:14.458935 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-03dd7338-2478-4b6d-825f-2927252e7713 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "DELETE /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 204 len: 0 microversion: 2.1 time: 0.345470 Aug 26 15:55:14.459736 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 311/614] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:55:14 2022] DELETE /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:55:14.468290 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-83ace8c8-d586-4448-a07a-f2f62be2ce25 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:14.468932 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-83ace8c8-d586-4448-a07a-f2f62be2ce25 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:14.475630 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-83ace8c8-d586-4448-a07a-f2f62be2ce25 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:14.476134 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-83ace8c8-d586-4448-a07a-f2f62be2ce25 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:14.476571 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-83ace8c8-d586-4448-a07a-f2f62be2ce25 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:14.477258 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-83ace8c8-d586-4448-a07a-f2f62be2ce25 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:14.477709 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-83ace8c8-d586-4448-a07a-f2f62be2ce25 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:14.478132 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-83ace8c8-d586-4448-a07a-f2f62be2ce25 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:14.612879 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-83ace8c8-d586-4448-a07a-f2f62be2ce25 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:14.621314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-83ace8c8-d586-4448-a07a-f2f62be2ce25 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1680 microversion: 2.1 time: 0.157270 Aug 26 15:55:14.626964 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 304/615] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:14 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:15.408206 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-aeca29a1-970f-41cb-a620-2e5ef016f43a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:15.410384 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-aeca29a1-970f-41cb-a620-2e5ef016f43a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:15.416976 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aeca29a1-970f-41cb-a620-2e5ef016f43a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:15.417457 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aeca29a1-970f-41cb-a620-2e5ef016f43a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:15.417969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aeca29a1-970f-41cb-a620-2e5ef016f43a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:15.418673 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aeca29a1-970f-41cb-a620-2e5ef016f43a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:15.419191 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aeca29a1-970f-41cb-a620-2e5ef016f43a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:15.419621 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aeca29a1-970f-41cb-a620-2e5ef016f43a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:15.451660 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-aeca29a1-970f-41cb-a620-2e5ef016f43a tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047876 Aug 26 15:55:15.452256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 312/616] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:15 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:15.643398 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1a5915f1-1772-44ec-84e6-21e98fbafeba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:15.644052 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-1a5915f1-1772-44ec-84e6-21e98fbafeba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:15.650812 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1a5915f1-1772-44ec-84e6-21e98fbafeba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:15.651507 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1a5915f1-1772-44ec-84e6-21e98fbafeba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:15.651726 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1a5915f1-1772-44ec-84e6-21e98fbafeba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:15.652456 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1a5915f1-1772-44ec-84e6-21e98fbafeba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:15.652906 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1a5915f1-1772-44ec-84e6-21e98fbafeba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:15.657551 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1a5915f1-1772-44ec-84e6-21e98fbafeba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:15.790776 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1a5915f1-1772-44ec-84e6-21e98fbafeba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:15.798562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-1a5915f1-1772-44ec-84e6-21e98fbafeba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1680 microversion: 2.1 time: 0.159082 Aug 26 15:55:15.799282 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 305/617] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:15 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:16.464728 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b362a87c-ec9d-4c31-9449-b8b1d4016603 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:16.466869 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b362a87c-ec9d-4c31-9449-b8b1d4016603 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:16.473887 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b362a87c-ec9d-4c31-9449-b8b1d4016603 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:16.474370 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b362a87c-ec9d-4c31-9449-b8b1d4016603 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:16.474839 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b362a87c-ec9d-4c31-9449-b8b1d4016603 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:16.475539 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b362a87c-ec9d-4c31-9449-b8b1d4016603 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:16.476030 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b362a87c-ec9d-4c31-9449-b8b1d4016603 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:16.476463 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b362a87c-ec9d-4c31-9449-b8b1d4016603 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:16.506703 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b362a87c-ec9d-4c31-9449-b8b1d4016603 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045952 Aug 26 15:55:16.507277 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 313/618] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:16 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:16.820239 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-237e45d5-ba2a-4c50-8e58-a9be4f4e362a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:16.820914 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-237e45d5-ba2a-4c50-8e58-a9be4f4e362a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:16.827570 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-237e45d5-ba2a-4c50-8e58-a9be4f4e362a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:16.828099 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-237e45d5-ba2a-4c50-8e58-a9be4f4e362a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:16.828535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-237e45d5-ba2a-4c50-8e58-a9be4f4e362a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:16.829226 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-237e45d5-ba2a-4c50-8e58-a9be4f4e362a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:16.829677 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-237e45d5-ba2a-4c50-8e58-a9be4f4e362a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:16.830101 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-237e45d5-ba2a-4c50-8e58-a9be4f4e362a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:16.963156 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-237e45d5-ba2a-4c50-8e58-a9be4f4e362a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:16.971012 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-237e45d5-ba2a-4c50-8e58-a9be4f4e362a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1680 microversion: 2.1 time: 0.154778 Aug 26 15:55:16.971585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 306/619] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:16 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:17.518889 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a65f3b36-fd7f-4b4f-8aae-d9efd80e88c4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:17.521632 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a65f3b36-fd7f-4b4f-8aae-d9efd80e88c4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:17.528336 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a65f3b36-fd7f-4b4f-8aae-d9efd80e88c4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:17.528820 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a65f3b36-fd7f-4b4f-8aae-d9efd80e88c4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:17.529254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a65f3b36-fd7f-4b4f-8aae-d9efd80e88c4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:17.529954 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a65f3b36-fd7f-4b4f-8aae-d9efd80e88c4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:17.530407 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a65f3b36-fd7f-4b4f-8aae-d9efd80e88c4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:17.530828 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a65f3b36-fd7f-4b4f-8aae-d9efd80e88c4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:17.562522 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a65f3b36-fd7f-4b4f-8aae-d9efd80e88c4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047525 Aug 26 15:55:17.563102 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 314/620] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:17 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:17.993389 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ba7a727b-c841-4147-b061-09cb22ad8ed7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:17.994018 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ba7a727b-c841-4147-b061-09cb22ad8ed7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:18.000938 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ba7a727b-c841-4147-b061-09cb22ad8ed7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:18.001430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ba7a727b-c841-4147-b061-09cb22ad8ed7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:18.001871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ba7a727b-c841-4147-b061-09cb22ad8ed7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:18.002590 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ba7a727b-c841-4147-b061-09cb22ad8ed7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:18.003054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ba7a727b-c841-4147-b061-09cb22ad8ed7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:18.003488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ba7a727b-c841-4147-b061-09cb22ad8ed7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:18.138921 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ba7a727b-c841-4147-b061-09cb22ad8ed7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:18.146724 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ba7a727b-c841-4147-b061-09cb22ad8ed7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1680 microversion: 2.1 time: 0.157252 Aug 26 15:55:18.147299 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 307/621] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:17 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:18.575945 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-22b334d2-45b0-486b-8b91-1272637d2c16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:18.578335 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-22b334d2-45b0-486b-8b91-1272637d2c16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:18.590339 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-22b334d2-45b0-486b-8b91-1272637d2c16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:18.590339 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-22b334d2-45b0-486b-8b91-1272637d2c16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:18.590339 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-22b334d2-45b0-486b-8b91-1272637d2c16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:18.590339 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-22b334d2-45b0-486b-8b91-1272637d2c16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:18.590880 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-22b334d2-45b0-486b-8b91-1272637d2c16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:18.590880 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-22b334d2-45b0-486b-8b91-1272637d2c16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:18.622226 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-22b334d2-45b0-486b-8b91-1272637d2c16 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050972 Aug 26 15:55:18.622797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 315/622] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:18 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:19.168960 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1505ed63-c9c5-4667-9418-472a241b5368 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:19.169504 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-1505ed63-c9c5-4667-9418-472a241b5368 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:19.176676 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1505ed63-c9c5-4667-9418-472a241b5368 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:19.177159 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1505ed63-c9c5-4667-9418-472a241b5368 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:19.177626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1505ed63-c9c5-4667-9418-472a241b5368 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:19.178324 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1505ed63-c9c5-4667-9418-472a241b5368 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:19.178774 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1505ed63-c9c5-4667-9418-472a241b5368 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:19.179198 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1505ed63-c9c5-4667-9418-472a241b5368 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:19.328156 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1505ed63-c9c5-4667-9418-472a241b5368 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:19.335979 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-1505ed63-c9c5-4667-9418-472a241b5368 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1680 microversion: 2.1 time: 0.170981 Aug 26 15:55:19.336550 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 308/623] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:19 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:19.634903 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e0913a8b-8e41-40dc-b4bc-99cbacfbc2e1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:19.637091 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e0913a8b-8e41-40dc-b4bc-99cbacfbc2e1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:19.643701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e0913a8b-8e41-40dc-b4bc-99cbacfbc2e1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:19.644258 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e0913a8b-8e41-40dc-b4bc-99cbacfbc2e1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:19.644773 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e0913a8b-8e41-40dc-b4bc-99cbacfbc2e1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:19.645462 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e0913a8b-8e41-40dc-b4bc-99cbacfbc2e1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:19.645916 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e0913a8b-8e41-40dc-b4bc-99cbacfbc2e1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:19.646341 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e0913a8b-8e41-40dc-b4bc-99cbacfbc2e1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:19.676683 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e0913a8b-8e41-40dc-b4bc-99cbacfbc2e1 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045286 Aug 26 15:55:19.677240 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 316/624] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:55:19 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 15:55:19.755023 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c7d04332-579f-4050-ad0b-48cb958aca25 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:19.755537 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c7d04332-579f-4050-ad0b-48cb958aca25 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:19.761818 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c7d04332-579f-4050-ad0b-48cb958aca25 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:19.762311 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c7d04332-579f-4050-ad0b-48cb958aca25 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:19.762750 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c7d04332-579f-4050-ad0b-48cb958aca25 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:19.763455 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c7d04332-579f-4050-ad0b-48cb958aca25 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:19.764118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c7d04332-579f-4050-ad0b-48cb958aca25 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:19.764550 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c7d04332-579f-4050-ad0b-48cb958aca25 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:19.790884 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c7d04332-579f-4050-ad0b-48cb958aca25 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Going to try to terminate instance {{(pid=127698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:55:20.083906 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c7d04332-579f-4050-ad0b-48cb958aca25 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "DELETE /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 204 len: 0 microversion: 2.1 time: 0.332424 Aug 26 15:55:20.084520 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 309/625] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:55:19 2022] DELETE /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:55:20.092902 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5a08c660-587a-4339-b4c5-eee837041869 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:20.093630 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5a08c660-587a-4339-b4c5-eee837041869 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:20.101237 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a08c660-587a-4339-b4c5-eee837041869 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:20.101867 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a08c660-587a-4339-b4c5-eee837041869 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:20.102307 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a08c660-587a-4339-b4c5-eee837041869 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:20.103019 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a08c660-587a-4339-b4c5-eee837041869 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:20.103471 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a08c660-587a-4339-b4c5-eee837041869 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:20.103926 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a08c660-587a-4339-b4c5-eee837041869 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:20.237516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5a08c660-587a-4339-b4c5-eee837041869 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:20.245479 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5a08c660-587a-4339-b4c5-eee837041869 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1690 microversion: 2.1 time: 0.156556 Aug 26 15:55:20.246040 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 317/626] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:20 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:20.359353 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-420c09ac-f438-4f68-a823-1021363b4a3f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:20.359768 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-420c09ac-f438-4f68-a823-1021363b4a3f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:20.366887 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-420c09ac-f438-4f68-a823-1021363b4a3f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:20.367605 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-420c09ac-f438-4f68-a823-1021363b4a3f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:20.368096 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-420c09ac-f438-4f68-a823-1021363b4a3f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:20.369297 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-420c09ac-f438-4f68-a823-1021363b4a3f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:20.369754 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-420c09ac-f438-4f68-a823-1021363b4a3f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:20.370182 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-420c09ac-f438-4f68-a823-1021363b4a3f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:20.443665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-420c09ac-f438-4f68-a823-1021363b4a3f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:20.453899 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-420c09ac-f438-4f68-a823-1021363b4a3f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1613 microversion: 2.1 time: 0.099851 Aug 26 15:55:20.454622 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 310/627] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:20 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1613 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:20.672984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-fdf507f3-5dae-4654-853b-37624368f9db req-0b52baae-171a-48db-882a-01c6fea04fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241a08df-4027-4153-8284-9ef744c15cb5", "name": "network-vif-deleted", "tag": "9978d447-2f15-4512-9675-bfc09607f200"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:20.683008 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-fdf507f3-5dae-4654-853b-37624368f9db req-0b52baae-171a-48db-882a-01c6fea04fd0 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:20.683497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-fdf507f3-5dae-4654-853b-37624368f9db req-0b52baae-171a-48db-882a-01c6fea04fd0 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:20.683958 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-fdf507f3-5dae-4654-853b-37624368f9db req-0b52baae-171a-48db-882a-01c6fea04fd0 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:20.695734 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-fdf507f3-5dae-4654-853b-37624368f9db req-0b52baae-171a-48db-882a-01c6fea04fd0 service nova] Creating event network-vif-deleted:9978d447-2f15-4512-9675-bfc09607f200 for instance 241a08df-4027-4153-8284-9ef744c15cb5 on hv-cinder-83124 Aug 26 15:55:20.700910 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-fdf507f3-5dae-4654-853b-37624368f9db req-0b52baae-171a-48db-882a-01c6fea04fd0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031980 Aug 26 15:55:20.701695 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 318/628] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:21.266725 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ae98de20-3215-44d3-9f98-118f82ae14b3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:21.267319 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ae98de20-3215-44d3-9f98-118f82ae14b3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:21.274609 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae98de20-3215-44d3-9f98-118f82ae14b3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:21.275094 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae98de20-3215-44d3-9f98-118f82ae14b3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:21.275530 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae98de20-3215-44d3-9f98-118f82ae14b3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:21.276257 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae98de20-3215-44d3-9f98-118f82ae14b3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:21.276788 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae98de20-3215-44d3-9f98-118f82ae14b3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:21.277222 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae98de20-3215-44d3-9f98-118f82ae14b3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:21.412457 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ae98de20-3215-44d3-9f98-118f82ae14b3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:21.420873 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ae98de20-3215-44d3-9f98-118f82ae14b3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1690 microversion: 2.1 time: 0.158090 Aug 26 15:55:21.421450 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 311/629] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:21 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:21.480176 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-3f4e8dec-93db-4dff-afb7-ca80e708dd27 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:21.480877 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-3f4e8dec-93db-4dff-afb7-ca80e708dd27 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:21.487462 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3f4e8dec-93db-4dff-afb7-ca80e708dd27 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:21.487966 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3f4e8dec-93db-4dff-afb7-ca80e708dd27 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:21.488440 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3f4e8dec-93db-4dff-afb7-ca80e708dd27 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:21.489144 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3f4e8dec-93db-4dff-afb7-ca80e708dd27 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:21.489583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3f4e8dec-93db-4dff-afb7-ca80e708dd27 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:21.489999 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3f4e8dec-93db-4dff-afb7-ca80e708dd27 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:21.554538 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-3f4e8dec-93db-4dff-afb7-ca80e708dd27 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:21.562934 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-3f4e8dec-93db-4dff-afb7-ca80e708dd27 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1613 microversion: 2.1 time: 0.090426 Aug 26 15:55:21.563498 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 319/630] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:21 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1613 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:21.609173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-acaa063a-9b46-494b-80b6-19cf59cc8c11 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:21.609665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-acaa063a-9b46-494b-80b6-19cf59cc8c11 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:21.611589 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:55:21.616608 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-acaa063a-9b46-494b-80b6-19cf59cc8c11 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:21.617222 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-acaa063a-9b46-494b-80b6-19cf59cc8c11 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:21.617664 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-acaa063a-9b46-494b-80b6-19cf59cc8c11 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:21.618359 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-acaa063a-9b46-494b-80b6-19cf59cc8c11 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:21.618814 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-acaa063a-9b46-494b-80b6-19cf59cc8c11 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:21.619237 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-acaa063a-9b46-494b-80b6-19cf59cc8c11 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:21.700270 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-acaa063a-9b46-494b-80b6-19cf59cc8c11 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lazy-loading 'services' on Instance uuid 5e9b0b71-315c-4701-8d05-04ad47287f13 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:55:21.980744 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-acaa063a-9b46-494b-80b6-19cf59cc8c11 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "DELETE /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13/os-volume_attachments/ba63c45e-c00f-4ce3-a93f-daba2fafc2c1" status: 202 len: 0 microversion: 2.1 time: 0.375313 Aug 26 15:55:21.981380 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 312/631] 10.222.0.98 () {58 vars in 1416 bytes} [Fri Aug 26 15:55:21 2022] DELETE /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13/os-volume_attachments/ba63c45e-c00f-4ce3-a93f-daba2fafc2c1 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:55:22.442433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-febc1405-db38-4165-ba12-6fece6972a4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:22.443033 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-febc1405-db38-4165-ba12-6fece6972a4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:22.449734 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-febc1405-db38-4165-ba12-6fece6972a4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:22.450240 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-febc1405-db38-4165-ba12-6fece6972a4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:22.450667 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-febc1405-db38-4165-ba12-6fece6972a4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:22.451342 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-febc1405-db38-4165-ba12-6fece6972a4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:22.451783 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-febc1405-db38-4165-ba12-6fece6972a4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:22.452227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-febc1405-db38-4165-ba12-6fece6972a4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:22.586186 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-90926420-17ff-4b6e-a654-48e2e045a3a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:22.586795 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-90926420-17ff-4b6e-a654-48e2e045a3a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:22.589877 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-febc1405-db38-4165-ba12-6fece6972a4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:22.594271 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-90926420-17ff-4b6e-a654-48e2e045a3a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:22.594768 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-90926420-17ff-4b6e-a654-48e2e045a3a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:22.595202 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-90926420-17ff-4b6e-a654-48e2e045a3a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:22.595940 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-90926420-17ff-4b6e-a654-48e2e045a3a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:22.596394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-90926420-17ff-4b6e-a654-48e2e045a3a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:22.596816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-90926420-17ff-4b6e-a654-48e2e045a3a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:22.603140 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-febc1405-db38-4165-ba12-6fece6972a4e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1690 microversion: 2.1 time: 0.164586 Aug 26 15:55:22.603901 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 320/632] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:22 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:22.668834 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-90926420-17ff-4b6e-a654-48e2e045a3a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:22.677423 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-90926420-17ff-4b6e-a654-48e2e045a3a7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1613 microversion: 2.1 time: 0.095826 Aug 26 15:55:22.677998 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 313/633] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:22 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:23.625286 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-2bf17e77-a9e0-4db2-ad3c-661ab4a855ce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:23.625896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-2bf17e77-a9e0-4db2-ad3c-661ab4a855ce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:23.633046 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bf17e77-a9e0-4db2-ad3c-661ab4a855ce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:23.633645 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bf17e77-a9e0-4db2-ad3c-661ab4a855ce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:23.634097 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bf17e77-a9e0-4db2-ad3c-661ab4a855ce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:23.634809 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bf17e77-a9e0-4db2-ad3c-661ab4a855ce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:23.635263 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bf17e77-a9e0-4db2-ad3c-661ab4a855ce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:23.635691 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2bf17e77-a9e0-4db2-ad3c-661ab4a855ce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:23.699194 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-73add7f9-bd1d-45a4-b941-68eda6b0600c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:23.704408 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-73add7f9-bd1d-45a4-b941-68eda6b0600c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:23.706232 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-73add7f9-bd1d-45a4-b941-68eda6b0600c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:23.706724 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-73add7f9-bd1d-45a4-b941-68eda6b0600c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:23.707193 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-73add7f9-bd1d-45a4-b941-68eda6b0600c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:23.707919 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-73add7f9-bd1d-45a4-b941-68eda6b0600c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:23.708371 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-73add7f9-bd1d-45a4-b941-68eda6b0600c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:23.708788 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-73add7f9-bd1d-45a4-b941-68eda6b0600c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:23.770609 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2bf17e77-a9e0-4db2-ad3c-661ab4a855ce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:23.775643 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-73add7f9-bd1d-45a4-b941-68eda6b0600c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:23.778839 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-2bf17e77-a9e0-4db2-ad3c-661ab4a855ce tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1690 microversion: 2.1 time: 0.157323 Aug 26 15:55:23.779363 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 321/634] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:23 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:23.783721 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-73add7f9-bd1d-45a4-b941-68eda6b0600c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1613 microversion: 2.1 time: 0.088547 Aug 26 15:55:23.784418 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 314/635] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:23 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:24.800018 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0f57d377-3381-491b-adea-c8ab2cb5cc0d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:24.801334 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0f57d377-3381-491b-adea-c8ab2cb5cc0d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:24.805095 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4b2a85a1-5ef2-477d-a61f-d35563a3f472 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:24.806257 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-4b2a85a1-5ef2-477d-a61f-d35563a3f472 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:24.807477 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0f57d377-3381-491b-adea-c8ab2cb5cc0d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:24.808004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0f57d377-3381-491b-adea-c8ab2cb5cc0d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:24.808565 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0f57d377-3381-491b-adea-c8ab2cb5cc0d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:24.809214 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0f57d377-3381-491b-adea-c8ab2cb5cc0d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:24.809837 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0f57d377-3381-491b-adea-c8ab2cb5cc0d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:24.810456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0f57d377-3381-491b-adea-c8ab2cb5cc0d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:24.813171 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b2a85a1-5ef2-477d-a61f-d35563a3f472 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:24.813666 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b2a85a1-5ef2-477d-a61f-d35563a3f472 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:24.814083 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b2a85a1-5ef2-477d-a61f-d35563a3f472 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:24.814947 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b2a85a1-5ef2-477d-a61f-d35563a3f472 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:24.815552 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b2a85a1-5ef2-477d-a61f-d35563a3f472 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:24.816147 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b2a85a1-5ef2-477d-a61f-d35563a3f472 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:24.839555 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:55:24.853206 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b2a85a1-5ef2-477d-a61f-d35563a3f472 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:24.853683 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b2a85a1-5ef2-477d-a61f-d35563a3f472 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:24.854108 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b2a85a1-5ef2-477d-a61f-d35563a3f472 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:24.854662 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-4b2a85a1-5ef2-477d-a61f-d35563a3f472 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lazy-loading 'fault' on Instance uuid 241a08df-4027-4153-8284-9ef744c15cb5 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:55:24.934917 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4b2a85a1-5ef2-477d-a61f-d35563a3f472 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:24.951829 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4b2a85a1-5ef2-477d-a61f-d35563a3f472 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1331 microversion: 2.1 time: 0.150435 Aug 26 15:55:24.967366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 315/636] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:24 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1331 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:25.028948 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0f57d377-3381-491b-adea-c8ab2cb5cc0d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:25.037548 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0f57d377-3381-491b-adea-c8ab2cb5cc0d tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1690 microversion: 2.1 time: 0.241422 Aug 26 15:55:25.038123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 322/637] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:24 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1690 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:25.428382 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-bf9d09c7-88c5-4a66-93e5-8689c9b60425 req-19f52ad5-5963-4f4b-a9b7-ee88eb7a13f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d976c8-85c3-48de-80ba-93fdff79445a", "name": "network-vif-deleted", "tag": "c5172524-b071-4da7-93f1-8465faf155b2"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:25.438387 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-bf9d09c7-88c5-4a66-93e5-8689c9b60425 req-19f52ad5-5963-4f4b-a9b7-ee88eb7a13f8 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:25.438857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-bf9d09c7-88c5-4a66-93e5-8689c9b60425 req-19f52ad5-5963-4f4b-a9b7-ee88eb7a13f8 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:25.439281 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-bf9d09c7-88c5-4a66-93e5-8689c9b60425 req-19f52ad5-5963-4f4b-a9b7-ee88eb7a13f8 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:25.451531 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-bf9d09c7-88c5-4a66-93e5-8689c9b60425 req-19f52ad5-5963-4f4b-a9b7-ee88eb7a13f8 service nova] Creating event network-vif-deleted:c5172524-b071-4da7-93f1-8465faf155b2 for instance 08d976c8-85c3-48de-80ba-93fdff79445a on hv-cinder-83124 Aug 26 15:55:25.456992 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-bf9d09c7-88c5-4a66-93e5-8689c9b60425 req-19f52ad5-5963-4f4b-a9b7-ee88eb7a13f8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032633 Aug 26 15:55:25.458412 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 316/638] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:25.975501 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-15584aa2-d581-4d1a-9db0-3e9ae372d3dc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:25.976307 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-15584aa2-d581-4d1a-9db0-3e9ae372d3dc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:25.988934 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-15584aa2-d581-4d1a-9db0-3e9ae372d3dc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:25.994691 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-15584aa2-d581-4d1a-9db0-3e9ae372d3dc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:25.994691 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-15584aa2-d581-4d1a-9db0-3e9ae372d3dc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:25.994691 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-15584aa2-d581-4d1a-9db0-3e9ae372d3dc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:25.994691 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-15584aa2-d581-4d1a-9db0-3e9ae372d3dc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:25.995330 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-15584aa2-d581-4d1a-9db0-3e9ae372d3dc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:26.029136 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-15584aa2-d581-4d1a-9db0-3e9ae372d3dc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:26.029891 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-15584aa2-d581-4d1a-9db0-3e9ae372d3dc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:26.030337 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-15584aa2-d581-4d1a-9db0-3e9ae372d3dc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:26.030787 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-15584aa2-d581-4d1a-9db0-3e9ae372d3dc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lazy-loading 'fault' on Instance uuid 241a08df-4027-4153-8284-9ef744c15cb5 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:55:26.060650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b681efb7-f15e-4b37-a0cb-da17f0d6e709 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:26.061997 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b681efb7-f15e-4b37-a0cb-da17f0d6e709 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:26.070128 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b681efb7-f15e-4b37-a0cb-da17f0d6e709 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:26.071971 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b681efb7-f15e-4b37-a0cb-da17f0d6e709 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:26.072760 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b681efb7-f15e-4b37-a0cb-da17f0d6e709 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:26.073503 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b681efb7-f15e-4b37-a0cb-da17f0d6e709 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:26.073975 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b681efb7-f15e-4b37-a0cb-da17f0d6e709 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:26.074444 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b681efb7-f15e-4b37-a0cb-da17f0d6e709 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:26.074848 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-15584aa2-d581-4d1a-9db0-3e9ae372d3dc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:26.090068 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-15584aa2-d581-4d1a-9db0-3e9ae372d3dc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 200 len: 1331 microversion: 2.1 time: 0.118956 Aug 26 15:55:26.106992 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 323/639] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:25 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 1331 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:26.110429 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b681efb7-f15e-4b37-a0cb-da17f0d6e709 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:26.111003 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b681efb7-f15e-4b37-a0cb-da17f0d6e709 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:26.111521 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b681efb7-f15e-4b37-a0cb-da17f0d6e709 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:26.112104 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-b681efb7-f15e-4b37-a0cb-da17f0d6e709 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lazy-loading 'fault' on Instance uuid 08d976c8-85c3-48de-80ba-93fdff79445a {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:55:26.158047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-b681efb7-f15e-4b37-a0cb-da17f0d6e709 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:26.167793 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-b681efb7-f15e-4b37-a0cb-da17f0d6e709 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1335 microversion: 2.1 time: 0.111295 Aug 26 15:55:26.168487 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 317/640] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:26 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1335 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:26.304812 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-aa3a7878-26be-4fa3-9952-a0d266c28706 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:26.305398 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-aa3a7878-26be-4fa3-9952-a0d266c28706 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:26.312225 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aa3a7878-26be-4fa3-9952-a0d266c28706 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:26.312710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aa3a7878-26be-4fa3-9952-a0d266c28706 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:26.313143 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aa3a7878-26be-4fa3-9952-a0d266c28706 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:26.313844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aa3a7878-26be-4fa3-9952-a0d266c28706 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:26.314297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aa3a7878-26be-4fa3-9952-a0d266c28706 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:26.314718 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aa3a7878-26be-4fa3-9952-a0d266c28706 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:26.341543 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-aa3a7878-26be-4fa3-9952-a0d266c28706 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Going to try to terminate instance {{(pid=127697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:55:26.357622 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:55:26.689629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-aa3a7878-26be-4fa3-9952-a0d266c28706 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "DELETE /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 204 len: 0 microversion: 2.1 time: 0.389024 Aug 26 15:55:26.693206 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 324/641] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:55:26 2022] DELETE /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 15:55:26.698806 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-301cf4f0-a251-493b-a1d9-ff42c037cd42 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:26.699448 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-301cf4f0-a251-493b-a1d9-ff42c037cd42 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:26.705303 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-301cf4f0-a251-493b-a1d9-ff42c037cd42 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:26.705776 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-301cf4f0-a251-493b-a1d9-ff42c037cd42 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:26.706204 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-301cf4f0-a251-493b-a1d9-ff42c037cd42 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:26.706887 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-301cf4f0-a251-493b-a1d9-ff42c037cd42 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:26.707830 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-301cf4f0-a251-493b-a1d9-ff42c037cd42 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:26.708341 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-301cf4f0-a251-493b-a1d9-ff42c037cd42 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:26.847055 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-301cf4f0-a251-493b-a1d9-ff42c037cd42 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:26.855597 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-301cf4f0-a251-493b-a1d9-ff42c037cd42 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1513 microversion: 2.1 time: 0.160882 Aug 26 15:55:26.856234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 318/642] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:26 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:27.114605 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-29807d14-8636-4a33-9c0c-90358444ba99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:27.115219 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-29807d14-8636-4a33-9c0c-90358444ba99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:27.121713 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-29807d14-8636-4a33-9c0c-90358444ba99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:27.122198 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-29807d14-8636-4a33-9c0c-90358444ba99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:27.122636 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-29807d14-8636-4a33-9c0c-90358444ba99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:27.123328 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-29807d14-8636-4a33-9c0c-90358444ba99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:27.123777 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-29807d14-8636-4a33-9c0c-90358444ba99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:27.124271 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-29807d14-8636-4a33-9c0c-90358444ba99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:27.137783 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-29807d14-8636-4a33-9c0c-90358444ba99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] HTTP exception thrown: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-29807d14-8636-4a33-9c0c-90358444ba99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Request method failure captured: Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 HTTP/1.1 Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOwce1DELhS8UmzpwnI-HX_EQrzE1_2dLaZIAb4DQQsaHzNq-4kKoCdv0aDJeKx2SvQqLHnYNV9XirCc5SAbojp-C1CHsa7OjA6o0rOrx5rLneplb_EX2pmB01iYBvFpO8o6110oFO2yAC5E6SvWdsfGmZrZ7TZSaR32s4VudVlpurQ Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:55:27.139416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:55:27.141084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f40d6476c750438c9c09107c7757fa95", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}] Aug 26 15:55:27.141084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:55:27.141084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:55:27.141084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:55:27.141084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:55:27.141084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:55:27.141084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:55:27.141084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 9348310fd06b473786d1c6be4f20c481 Aug 26 15:55:27.141084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:55:27.141084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:55:27.141084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. Aug 26 15:55:27.141084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '241a08df-4027-4153-8284-9ef744c15cb5'} Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:55:27.142047 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. Aug 26 15:55:27.143589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:55:27.144998 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-29807d14-8636-4a33-9c0c-90358444ba99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Returning 404 to user: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:55:27.144998 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-29807d14-8636-4a33-9c0c-90358444ba99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 404 len: 111 microversion: 2.1 time: 0.031197 Aug 26 15:55:27.144998 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 325/643] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:27 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:55:27.150113 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4b67c835-638b-41e4-88ed-67cac8996f8a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '.version_select at 0x7fbd1e4ba940>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:27.189365 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-793d602e-28f7-4a64-a4c9-de2ea6e2e348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:27.189984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-793d602e-28f7-4a64-a4c9-de2ea6e2e348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:27.196136 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-793d602e-28f7-4a64-a4c9-de2ea6e2e348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:27.196609 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-793d602e-28f7-4a64-a4c9-de2ea6e2e348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:27.197037 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-793d602e-28f7-4a64-a4c9-de2ea6e2e348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:27.197984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-793d602e-28f7-4a64-a4c9-de2ea6e2e348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:27.198426 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-793d602e-28f7-4a64-a4c9-de2ea6e2e348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:27.198841 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-793d602e-28f7-4a64-a4c9-de2ea6e2e348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:27.234779 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-793d602e-28f7-4a64-a4c9-de2ea6e2e348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:27.234779 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-793d602e-28f7-4a64-a4c9-de2ea6e2e348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:27.234779 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-793d602e-28f7-4a64-a4c9-de2ea6e2e348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:27.234779 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-793d602e-28f7-4a64-a4c9-de2ea6e2e348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lazy-loading 'fault' on Instance uuid 08d976c8-85c3-48de-80ba-93fdff79445a {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:55:27.239997 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4b67c835-638b-41e4-88ed-67cac8996f8a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411814874" status: 202 len: 0 microversion: 2.1 time: 0.088151 Aug 26 15:55:27.239997 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 319/644] 10.222.0.98 () {58 vars in 1221 bytes} [Fri Aug 26 15:55:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411814874 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:55:27.277601 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-793d602e-28f7-4a64-a4c9-de2ea6e2e348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:27.286068 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-793d602e-28f7-4a64-a4c9-de2ea6e2e348 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1335 microversion: 2.1 time: 0.099957 Aug 26 15:55:27.286645 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 326/645] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:27 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1335 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:27.876772 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0d1eba83-db5c-4c4f-8401-53f7fa8634c7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:27.877312 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0d1eba83-db5c-4c4f-8401-53f7fa8634c7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:27.885237 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d1eba83-db5c-4c4f-8401-53f7fa8634c7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:27.885731 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d1eba83-db5c-4c4f-8401-53f7fa8634c7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:27.886199 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d1eba83-db5c-4c4f-8401-53f7fa8634c7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:27.886995 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d1eba83-db5c-4c4f-8401-53f7fa8634c7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:27.887452 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d1eba83-db5c-4c4f-8401-53f7fa8634c7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:27.887894 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d1eba83-db5c-4c4f-8401-53f7fa8634c7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:28.034779 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0d1eba83-db5c-4c4f-8401-53f7fa8634c7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:28.043083 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0d1eba83-db5c-4c4f-8401-53f7fa8634c7 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1513 microversion: 2.1 time: 0.170778 Aug 26 15:55:28.046616 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 320/646] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:27 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:28.237609 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c10de596-412b-4d66-a04b-852a39e61bef tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Action: 'create', calling method: .version_select at 0x7fbd1e20eb80>, body: {"keypair": {"name": "tempest-keypair-2063969869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaWL84ZIcfrJVf2Y7BMiql2dacw0bxZYuMcgfgQuKMMUoSiwKe5Zdh+qLCHuhaV0l7q14HnsUtTg06W7vCusYFCkEZNA16CjGPJVLaWFMKkIlOkZ54PtV0h5OhCiIgyFg=="}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:28.253505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-c10de596-412b-4d66-a04b-852a39e61bef tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for project f40d6476c750438c9c09107c7757fa95. Resources: {'key_pairs'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:55:28.255678 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:55:28.257837 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-c10de596-412b-4d66-a04b-852a39e61bef tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for user 9348310fd06b473786d1c6be4f20c481 and project f40d6476c750438c9c09107c7757fa95. Resources: {'key_pairs'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:55:28.306506 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4c650bfc-6c03-4bf4-a270-4c0a7d1e6126 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:28.307123 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-4c650bfc-6c03-4bf4-a270-4c0a7d1e6126 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:28.313787 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4c650bfc-6c03-4bf4-a270-4c0a7d1e6126 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:28.314274 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4c650bfc-6c03-4bf4-a270-4c0a7d1e6126 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:28.314708 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4c650bfc-6c03-4bf4-a270-4c0a7d1e6126 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:28.315408 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4c650bfc-6c03-4bf4-a270-4c0a7d1e6126 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:28.315860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4c650bfc-6c03-4bf4-a270-4c0a7d1e6126 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:28.316307 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4c650bfc-6c03-4bf4-a270-4c0a7d1e6126 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:28.348612 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4c650bfc-6c03-4bf4-a270-4c0a7d1e6126 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:28.349115 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4c650bfc-6c03-4bf4-a270-4c0a7d1e6126 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:28.349524 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4c650bfc-6c03-4bf4-a270-4c0a7d1e6126 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:28.349967 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-4c650bfc-6c03-4bf4-a270-4c0a7d1e6126 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lazy-loading 'fault' on Instance uuid 08d976c8-85c3-48de-80ba-93fdff79445a {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:55:28.353395 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c10de596-412b-4d66-a04b-852a39e61bef tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119568 Aug 26 15:55:28.354006 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 327/647] 10.222.0.98 () {60 vars in 1159 bytes} [Fri Aug 26 15:55:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:28.395618 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4c650bfc-6c03-4bf4-a270-4c0a7d1e6126 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:28.403703 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4c650bfc-6c03-4bf4-a270-4c0a7d1e6126 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 200 len: 1335 microversion: 2.1 time: 0.100893 Aug 26 15:55:28.404319 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 321/648] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:28 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 1335 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:29.063630 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7ab70ef1-d86f-4b90-9b95-97887590d642 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:29.064269 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7ab70ef1-d86f-4b90-9b95-97887590d642 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:29.070927 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7ab70ef1-d86f-4b90-9b95-97887590d642 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:29.071413 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7ab70ef1-d86f-4b90-9b95-97887590d642 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:29.071856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7ab70ef1-d86f-4b90-9b95-97887590d642 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:29.072848 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7ab70ef1-d86f-4b90-9b95-97887590d642 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:29.073300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7ab70ef1-d86f-4b90-9b95-97887590d642 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:29.073722 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7ab70ef1-d86f-4b90-9b95-97887590d642 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:29.231591 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7ab70ef1-d86f-4b90-9b95-97887590d642 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:29.239757 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7ab70ef1-d86f-4b90-9b95-97887590d642 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1513 microversion: 2.1 time: 0.180018 Aug 26 15:55:29.241064 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 328/649] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:29 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:29.424427 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-11205d84-1db9-4491-9e97-1d1f18213592 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:29.425036 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-11205d84-1db9-4491-9e97-1d1f18213592 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: 08d976c8-85c3-48de-80ba-93fdff79445a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:29.435184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-11205d84-1db9-4491-9e97-1d1f18213592 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:29.436147 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-11205d84-1db9-4491-9e97-1d1f18213592 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:29.436581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-11205d84-1db9-4491-9e97-1d1f18213592 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:29.437793 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-11205d84-1db9-4491-9e97-1d1f18213592 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:29.437793 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-11205d84-1db9-4491-9e97-1d1f18213592 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:29.438144 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-11205d84-1db9-4491-9e97-1d1f18213592 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:29.452784 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-11205d84-1db9-4491-9e97-1d1f18213592 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] HTTP exception thrown: Instance 08d976c8-85c3-48de-80ba-93fdff79445a could not be found. Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-11205d84-1db9-4491-9e97-1d1f18213592 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Request method failure captured: Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a HTTP/1.1 Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOu4mB4haQKordFhuZBlwEB2sjzB1Ggq0RGqd_gZMlk7fOoxmsTjHxDr7EkB7u8NObi4d6APbLdClBiJmlJAqHVshko5l_rzaX5t4_54zFPQBeYab44MgJPCU1k-0j6OBkr3q7IvEClkDHMwJxZPzPX7sgNHTQ4qdi7FVVy-db3TXrw Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: 853df33daae14bd9825788afd555e11a Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1564618252 Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:55:29.454439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:55:29.456050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/853df33daae14bd9825788afd555e11a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_853df33daae14bd9825788afd555e11a", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/853df33daae14bd9825788afd555e11a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/853df33daae14bd9825788afd555e11a"}]}] Aug 26 15:55:29.456050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1564618252 Aug 26 15:55:29.456050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: 853df33daae14bd9825788afd555e11a Aug 26 15:55:29.456050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1564618252 Aug 26 15:55:29.456050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-ServerRescueNegativeTestJSON-1564618252-project Aug 26 15:55:29.456050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:55:29.456050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:55:29.456050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 5c01a893d3ab42cc97508768791ff38e Aug 26 15:55:29.456050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1564618252-project Aug 26 15:55:29.456050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:55:29.456050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance 08d976c8-85c3-48de-80ba-93fdff79445a could not be found. Aug 26 15:55:29.456050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '08d976c8-85c3-48de-80ba-93fdff79445a'} Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08d976c8-85c3-48de-80ba-93fdff79445a could not be found. Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:55:29.456863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08d976c8-85c3-48de-80ba-93fdff79445a could not be found. Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08d976c8-85c3-48de-80ba-93fdff79445a could not be found. Aug 26 15:55:29.458856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:29.460485 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-11205d84-1db9-4491-9e97-1d1f18213592 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Returning 404 to user: Instance 08d976c8-85c3-48de-80ba-93fdff79445a could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:55:29.460485 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-11205d84-1db9-4491-9e97-1d1f18213592 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a" status: 404 len: 111 microversion: 2.1 time: 0.035375 Aug 26 15:55:29.460485 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 322/650] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:29 2022] GET /compute/v2.1/servers/08d976c8-85c3-48de-80ba-93fdff79445a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:55:29.465697 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-23759303-f96f-482a-a246-f6cba85f4dc4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '.version_select at 0x7fbd1e2de940>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:29.534037 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-23759303-f96f-482a-a246-f6cba85f4dc4 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-175078371" status: 202 len: 0 microversion: 2.1 time: 0.072279 Aug 26 15:55:29.534682 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 329/651] 10.222.0.98 () {58 vars in 1218 bytes} [Fri Aug 26 15:55:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-175078371 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:55:29.611438 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-1512d885-b6f7-44ee-902a-5f66f10a5e76 req-1dd565da-500a-4620-b620-07b22b8d228f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e9b0b71-315c-4701-8d05-04ad47287f13", "name": "network-vif-deleted", "tag": "c403c367-d759-4ca4-b284-2bda6e58d872"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:29.621644 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-1512d885-b6f7-44ee-902a-5f66f10a5e76 req-1dd565da-500a-4620-b620-07b22b8d228f service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:29.622125 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-1512d885-b6f7-44ee-902a-5f66f10a5e76 req-1dd565da-500a-4620-b620-07b22b8d228f service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:29.622559 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-1512d885-b6f7-44ee-902a-5f66f10a5e76 req-1dd565da-500a-4620-b620-07b22b8d228f service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:29.634133 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-1512d885-b6f7-44ee-902a-5f66f10a5e76 req-1dd565da-500a-4620-b620-07b22b8d228f service nova] Creating event network-vif-deleted:c403c367-d759-4ca4-b284-2bda6e58d872 for instance 5e9b0b71-315c-4701-8d05-04ad47287f13 on hv-cinder-83124 Aug 26 15:55:29.639373 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-1512d885-b6f7-44ee-902a-5f66f10a5e76 req-1dd565da-500a-4620-b620-07b22b8d228f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031689 Aug 26 15:55:29.640218 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 323/652] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:30.262594 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-17687780-adc1-4792-af22-e0dd1d3d3052 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:30.263889 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-17687780-adc1-4792-af22-e0dd1d3d3052 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:30.271687 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-17687780-adc1-4792-af22-e0dd1d3d3052 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:30.272231 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-17687780-adc1-4792-af22-e0dd1d3d3052 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:30.272670 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-17687780-adc1-4792-af22-e0dd1d3d3052 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:30.273453 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-17687780-adc1-4792-af22-e0dd1d3d3052 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:30.273906 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-17687780-adc1-4792-af22-e0dd1d3d3052 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:30.274331 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-17687780-adc1-4792-af22-e0dd1d3d3052 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:30.307772 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-17687780-adc1-4792-af22-e0dd1d3d3052 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:30.308315 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-17687780-adc1-4792-af22-e0dd1d3d3052 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:30.308763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-17687780-adc1-4792-af22-e0dd1d3d3052 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:30.309473 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-17687780-adc1-4792-af22-e0dd1d3d3052 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lazy-loading 'fault' on Instance uuid 5e9b0b71-315c-4701-8d05-04ad47287f13 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:55:30.354476 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-17687780-adc1-4792-af22-e0dd1d3d3052 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28436612400e421ca52f902542186a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4bab21dc3141bd89ee2ea54fe0c14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:30.362570 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-17687780-adc1-4792-af22-e0dd1d3d3052 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 200 len: 1308 microversion: 2.1 time: 0.103816 Aug 26 15:55:30.364223 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 330/653] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:30 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:30.937897 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-116805685", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a335b766-ffd8-4d30-a4fc-6d81d957bfbd"}], "security_groups": [{"name": "tempest-securitygroup--1452208241"}], "key_name": "tempest-keypair-2063969869", "user_data": "}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:31.057748 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.network.neutron [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] validate_networks() for [('a335b766-ffd8-4d30-a4fc-6d81d957bfbd', None, None, None, None, None)] {{(pid=127698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:55:31.384632 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-04e4fa5b-2774-45ec-b8a2-0b925f7a5045 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:31.385245 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-04e4fa5b-2774-45ec-b8a2-0b925f7a5045 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] [instance: 5e9b0b71-315c-4701-8d05-04ad47287f13] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:31.392358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-04e4fa5b-2774-45ec-b8a2-0b925f7a5045 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:31.392842 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-04e4fa5b-2774-45ec-b8a2-0b925f7a5045 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:31.393338 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-04e4fa5b-2774-45ec-b8a2-0b925f7a5045 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:31.394044 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-04e4fa5b-2774-45ec-b8a2-0b925f7a5045 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:31.394511 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-04e4fa5b-2774-45ec-b8a2-0b925f7a5045 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:31.395526 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-04e4fa5b-2774-45ec-b8a2-0b925f7a5045 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:31.409656 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-04e4fa5b-2774-45ec-b8a2-0b925f7a5045 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] HTTP exception thrown: Instance 5e9b0b71-315c-4701-8d05-04ad47287f13 could not be found. Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-04e4fa5b-2774-45ec-b8a2-0b925f7a5045 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Request method failure captured: Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 HTTP/1.1 Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOxFhDLMK6khBXGytfsH69lwb8FhxEZ_E3mnHJHG8QgW-MnA-CFf89yVmKt9srw6BLTgMFMVZEU4QU48flVsPM_j0A9qlrjpaklfLGKocO5g109aEiNKRN-tLwDJIzBFDLtGRsk9Me3Q6KcWDc19cVJkKmBJSRVlLaij2ISS32-oK-s Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: 7e4bab21dc3141bd89ee2ea54fe0c14c Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-VolumesSnapshotTestJSON-447155880 Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:55:31.411756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:55:31.413130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/7e4bab21dc3141bd89ee2ea54fe0c14c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_7e4bab21dc3141bd89ee2ea54fe0c14c", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7e4bab21dc3141bd89ee2ea54fe0c14c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7e4bab21dc3141bd89ee2ea54fe0c14c"}]}] Aug 26 15:55:31.413130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-VolumesSnapshotTestJSON-447155880 Aug 26 15:55:31.413130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: 7e4bab21dc3141bd89ee2ea54fe0c14c Aug 26 15:55:31.413130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-447155880 Aug 26 15:55:31.413130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-VolumesSnapshotTestJSON-447155880-project Aug 26 15:55:31.413130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:55:31.413130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:55:31.413130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 28436612400e421ca52f902542186a68 Aug 26 15:55:31.413130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-VolumesSnapshotTestJSON-447155880-project Aug 26 15:55:31.413130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:55:31.413130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 5e9b0b71-315c-4701-8d05-04ad47287f13 could not be found. Aug 26 15:55:31.413130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '5e9b0b71-315c-4701-8d05-04ad47287f13'} Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e9b0b71-315c-4701-8d05-04ad47287f13 could not be found. Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:55:31.413952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e9b0b71-315c-4701-8d05-04ad47287f13 could not be found. Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e9b0b71-315c-4701-8d05-04ad47287f13 could not be found. Aug 26 15:55:31.415796 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:55:31.424928 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-04e4fa5b-2774-45ec-b8a2-0b925f7a5045 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] Returning 404 to user: Instance 5e9b0b71-315c-4701-8d05-04ad47287f13 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:55:31.424928 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-04e4fa5b-2774-45ec-b8a2-0b925f7a5045 tempest-VolumesSnapshotTestJSON-447155880 tempest-VolumesSnapshotTestJSON-447155880-project] 10.222.0.98 "GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13" status: 404 len: 111 microversion: 2.1 time: 0.032789 Aug 26 15:55:31.424928 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 331/654] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:31 2022] GET /compute/v2.1/servers/5e9b0b71-315c-4701-8d05-04ad47287f13 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 15:55:31.484136 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Flavor limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:55:31.484677 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Image limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:55:31.485039 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Flavor pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:55:31.485480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Image pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:55:31.485901 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:55:31.495636 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:31.496303 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:31.496851 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:31.497644 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:31.498101 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:31.498525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:31.516027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for project f40d6476c750438c9c09107c7757fa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:55:31.520116 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for user 9348310fd06b473786d1c6be4f20c481 and project f40d6476c750438c9c09107c7757fa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:55:31.536523 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Going to run 1 instances... {{(pid=127698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:55:31.539275 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:55:31.692510 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d214384d-0ff8-4aaa-89a4-3ebdaa226afe tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.759831 Aug 26 15:55:31.693067 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 324/655] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:55:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:55:31.704770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-baa0552d-3c00-4812-b03b-6d8326468c74 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:31.705403 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-baa0552d-3c00-4812-b03b-6d8326468c74 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:31.772357 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-baa0552d-3c00-4812-b03b-6d8326468c74 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:31.779245 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-baa0552d-3c00-4812-b03b-6d8326468c74 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1241 microversion: 2.1 time: 0.078594 Aug 26 15:55:31.779818 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 332/656] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:31 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:32.800836 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-dbd7f8dd-fe50-456d-9ecc-ccfe5dfcbbcc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:32.801977 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-dbd7f8dd-fe50-456d-9ecc-ccfe5dfcbbcc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:32.810424 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-dbd7f8dd-fe50-456d-9ecc-ccfe5dfcbbcc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:32.810909 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-dbd7f8dd-fe50-456d-9ecc-ccfe5dfcbbcc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:32.811350 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-dbd7f8dd-fe50-456d-9ecc-ccfe5dfcbbcc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:32.812136 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-dbd7f8dd-fe50-456d-9ecc-ccfe5dfcbbcc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:32.812598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-dbd7f8dd-fe50-456d-9ecc-ccfe5dfcbbcc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:32.813024 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-dbd7f8dd-fe50-456d-9ecc-ccfe5dfcbbcc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:32.874671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-dbd7f8dd-fe50-456d-9ecc-ccfe5dfcbbcc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:32.883129 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-dbd7f8dd-fe50-456d-9ecc-ccfe5dfcbbcc tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1245 microversion: 2.1 time: 0.086866 Aug 26 15:55:32.883701 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 325/657] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:32 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:33.357231 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a1ed579a-3ed5-49ef-ae8f-ed4eab35aead tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:33.357789 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a1ed579a-3ed5-49ef-ae8f-ed4eab35aead tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:33.364991 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1ed579a-3ed5-49ef-ae8f-ed4eab35aead tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:33.365477 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1ed579a-3ed5-49ef-ae8f-ed4eab35aead tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:33.365913 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1ed579a-3ed5-49ef-ae8f-ed4eab35aead tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:33.366655 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1ed579a-3ed5-49ef-ae8f-ed4eab35aead tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:33.367101 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1ed579a-3ed5-49ef-ae8f-ed4eab35aead tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:33.367524 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1ed579a-3ed5-49ef-ae8f-ed4eab35aead tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:33.394306 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a1ed579a-3ed5-49ef-ae8f-ed4eab35aead tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Going to try to terminate instance {{(pid=127697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:55:33.638243 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a1ed579a-3ed5-49ef-ae8f-ed4eab35aead tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 204 len: 0 microversion: 2.1 time: 0.284726 Aug 26 15:55:33.638822 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 333/658] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:55:33 2022] DELETE /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:55:33.647577 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8ef01f3e-0e97-4425-b98e-534939b4332f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:33.648219 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-8ef01f3e-0e97-4425-b98e-534939b4332f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:33.654259 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8ef01f3e-0e97-4425-b98e-534939b4332f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:33.654746 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8ef01f3e-0e97-4425-b98e-534939b4332f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:33.655182 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8ef01f3e-0e97-4425-b98e-534939b4332f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:33.655900 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8ef01f3e-0e97-4425-b98e-534939b4332f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:33.656465 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8ef01f3e-0e97-4425-b98e-534939b4332f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:33.656885 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8ef01f3e-0e97-4425-b98e-534939b4332f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:33.789218 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8ef01f3e-0e97-4425-b98e-534939b4332f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:33.796953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-8ef01f3e-0e97-4425-b98e-534939b4332f tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1508 microversion: 2.1 time: 0.153978 Aug 26 15:55:33.797517 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 326/659] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:33 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:33.903800 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e3d1f1fa-85db-4335-8fed-a98cbbc9765d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:33.904706 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e3d1f1fa-85db-4335-8fed-a98cbbc9765d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:33.911222 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e3d1f1fa-85db-4335-8fed-a98cbbc9765d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:33.911697 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e3d1f1fa-85db-4335-8fed-a98cbbc9765d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:33.912168 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e3d1f1fa-85db-4335-8fed-a98cbbc9765d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:33.912890 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e3d1f1fa-85db-4335-8fed-a98cbbc9765d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:33.913342 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e3d1f1fa-85db-4335-8fed-a98cbbc9765d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:33.913763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e3d1f1fa-85db-4335-8fed-a98cbbc9765d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:33.976419 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e3d1f1fa-85db-4335-8fed-a98cbbc9765d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:33.983930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e3d1f1fa-85db-4335-8fed-a98cbbc9765d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1293 microversion: 2.1 time: 0.084468 Aug 26 15:55:33.984494 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 334/660] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:33 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:34.475623 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f2ada344-ea23-4e10-a4c6-5c8e77d9cbee tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:34.477989 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f2ada344-ea23-4e10-a4c6-5c8e77d9cbee tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:34.484461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2ada344-ea23-4e10-a4c6-5c8e77d9cbee tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:34.484936 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2ada344-ea23-4e10-a4c6-5c8e77d9cbee tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:34.485361 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2ada344-ea23-4e10-a4c6-5c8e77d9cbee tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:34.486043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2ada344-ea23-4e10-a4c6-5c8e77d9cbee tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:34.486486 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2ada344-ea23-4e10-a4c6-5c8e77d9cbee tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:34.486900 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2ada344-ea23-4e10-a4c6-5c8e77d9cbee tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:34.682185 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f2ada344-ea23-4e10-a4c6-5c8e77d9cbee tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "POST /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/action" status: 202 len: 0 microversion: 2.1 time: 0.210736 Aug 26 15:55:34.682960 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 327/661] 10.222.0.98 () {60 vars in 1278 bytes} [Fri Aug 26 15:55:34 2022] POST /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:55:34.691023 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0b40cbb6-5c23-446c-b631-200a54a0ce05 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:34.691634 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0b40cbb6-5c23-446c-b631-200a54a0ce05 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:34.698522 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0b40cbb6-5c23-446c-b631-200a54a0ce05 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:34.699004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0b40cbb6-5c23-446c-b631-200a54a0ce05 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:34.699438 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0b40cbb6-5c23-446c-b631-200a54a0ce05 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:34.700153 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0b40cbb6-5c23-446c-b631-200a54a0ce05 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:34.700604 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0b40cbb6-5c23-446c-b631-200a54a0ce05 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:34.701024 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0b40cbb6-5c23-446c-b631-200a54a0ce05 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:34.818399 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-bf266e3e-4c02-476b-bed3-a9c37ee45961 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:34.819104 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-bf266e3e-4c02-476b-bed3-a9c37ee45961 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:34.825661 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bf266e3e-4c02-476b-bed3-a9c37ee45961 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:34.826145 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bf266e3e-4c02-476b-bed3-a9c37ee45961 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:34.826581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bf266e3e-4c02-476b-bed3-a9c37ee45961 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:34.827271 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bf266e3e-4c02-476b-bed3-a9c37ee45961 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:34.827723 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bf266e3e-4c02-476b-bed3-a9c37ee45961 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:34.828292 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bf266e3e-4c02-476b-bed3-a9c37ee45961 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:34.845920 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0b40cbb6-5c23-446c-b631-200a54a0ce05 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:34.853961 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0b40cbb6-5c23-446c-b631-200a54a0ce05 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1751 microversion: 2.1 time: 0.166800 Aug 26 15:55:34.854514 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 335/662] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:34 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:34.956137 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-bf266e3e-4c02-476b-bed3-a9c37ee45961 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:34.964061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-bf266e3e-4c02-476b-bed3-a9c37ee45961 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1508 microversion: 2.1 time: 0.150613 Aug 26 15:55:34.964625 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 328/663] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:34 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:35.005955 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a1e4282d-4fa0-4e35-8e4f-1dfefb8ee535 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:35.006561 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a1e4282d-4fa0-4e35-8e4f-1dfefb8ee535 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:35.012578 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1e4282d-4fa0-4e35-8e4f-1dfefb8ee535 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:35.013054 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1e4282d-4fa0-4e35-8e4f-1dfefb8ee535 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:35.013487 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1e4282d-4fa0-4e35-8e4f-1dfefb8ee535 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:35.014168 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1e4282d-4fa0-4e35-8e4f-1dfefb8ee535 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:35.014615 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1e4282d-4fa0-4e35-8e4f-1dfefb8ee535 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:35.015034 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1e4282d-4fa0-4e35-8e4f-1dfefb8ee535 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:35.076823 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a1e4282d-4fa0-4e35-8e4f-1dfefb8ee535 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:35.084481 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a1e4282d-4fa0-4e35-8e4f-1dfefb8ee535 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1293 microversion: 2.1 time: 0.082942 Aug 26 15:55:35.085052 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 336/664] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:35 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:35.875962 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-cb61b630-f0be-4561-9be3-93fe7355d6fe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:35.876473 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-cb61b630-f0be-4561-9be3-93fe7355d6fe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:35.883420 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb61b630-f0be-4561-9be3-93fe7355d6fe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:35.883936 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb61b630-f0be-4561-9be3-93fe7355d6fe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:35.884374 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb61b630-f0be-4561-9be3-93fe7355d6fe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:35.885063 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb61b630-f0be-4561-9be3-93fe7355d6fe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:35.885516 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb61b630-f0be-4561-9be3-93fe7355d6fe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:35.885940 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cb61b630-f0be-4561-9be3-93fe7355d6fe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:35.984642 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-27f0c596-c48a-4c06-ab6b-39fca3ef9c51 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:35.985255 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-27f0c596-c48a-4c06-ab6b-39fca3ef9c51 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:35.992392 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-27f0c596-c48a-4c06-ab6b-39fca3ef9c51 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:35.992875 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-27f0c596-c48a-4c06-ab6b-39fca3ef9c51 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:35.993314 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-27f0c596-c48a-4c06-ab6b-39fca3ef9c51 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:35.994013 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-27f0c596-c48a-4c06-ab6b-39fca3ef9c51 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:35.994465 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-27f0c596-c48a-4c06-ab6b-39fca3ef9c51 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:35.994890 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-27f0c596-c48a-4c06-ab6b-39fca3ef9c51 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:36.030228 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-cb61b630-f0be-4561-9be3-93fe7355d6fe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:36.039245 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-cb61b630-f0be-4561-9be3-93fe7355d6fe tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1751 microversion: 2.1 time: 0.167200 Aug 26 15:55:36.039829 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 329/665] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:35 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:36.105140 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e84b0341-8664-44ef-bae4-84de4bd0804a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:36.105752 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e84b0341-8664-44ef-bae4-84de4bd0804a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:36.111783 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e84b0341-8664-44ef-bae4-84de4bd0804a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:36.112307 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e84b0341-8664-44ef-bae4-84de4bd0804a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:36.112816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e84b0341-8664-44ef-bae4-84de4bd0804a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:36.113607 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e84b0341-8664-44ef-bae4-84de4bd0804a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:36.114600 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e84b0341-8664-44ef-bae4-84de4bd0804a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:36.115027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e84b0341-8664-44ef-bae4-84de4bd0804a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:36.128939 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-27f0c596-c48a-4c06-ab6b-39fca3ef9c51 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:36.137107 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-27f0c596-c48a-4c06-ab6b-39fca3ef9c51 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1508 microversion: 2.1 time: 0.156375 Aug 26 15:55:36.137682 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 337/666] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:35 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:36.180428 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e84b0341-8664-44ef-bae4-84de4bd0804a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:36.188161 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e84b0341-8664-44ef-bae4-84de4bd0804a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1293 microversion: 2.1 time: 0.086802 Aug 26 15:55:36.188735 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 330/667] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:36 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:37.061083 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a32ec154-9fe2-4a93-ade6-ad384d66dff4 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:37.061707 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a32ec154-9fe2-4a93-ade6-ad384d66dff4 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:37.068052 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a32ec154-9fe2-4a93-ade6-ad384d66dff4 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:37.068522 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a32ec154-9fe2-4a93-ade6-ad384d66dff4 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:37.068949 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a32ec154-9fe2-4a93-ade6-ad384d66dff4 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:37.069625 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a32ec154-9fe2-4a93-ade6-ad384d66dff4 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:37.070072 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a32ec154-9fe2-4a93-ade6-ad384d66dff4 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:37.070487 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a32ec154-9fe2-4a93-ade6-ad384d66dff4 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:37.158059 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-74a1fd9c-f168-49b0-b284-c529da36f4b9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:37.158589 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-74a1fd9c-f168-49b0-b284-c529da36f4b9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:37.165809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-74a1fd9c-f168-49b0-b284-c529da36f4b9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:37.166473 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-74a1fd9c-f168-49b0-b284-c529da36f4b9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:37.168420 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-74a1fd9c-f168-49b0-b284-c529da36f4b9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:37.168420 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-74a1fd9c-f168-49b0-b284-c529da36f4b9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:37.168420 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-74a1fd9c-f168-49b0-b284-c529da36f4b9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:37.168725 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-74a1fd9c-f168-49b0-b284-c529da36f4b9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:37.219034 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a32ec154-9fe2-4a93-ade6-ad384d66dff4 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:37.227943 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a32ec154-9fe2-4a93-ade6-ad384d66dff4 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1751 microversion: 2.1 time: 0.170646 Aug 26 15:55:37.228519 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 338/668] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:37 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:37.234705 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a1775ae5-c410-4c38-b70c-e40678593dfb tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:37.235308 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a1775ae5-c410-4c38-b70c-e40678593dfb tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:37.243683 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1775ae5-c410-4c38-b70c-e40678593dfb tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:37.244192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1775ae5-c410-4c38-b70c-e40678593dfb tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:37.244629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1775ae5-c410-4c38-b70c-e40678593dfb tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:37.245322 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1775ae5-c410-4c38-b70c-e40678593dfb tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:37.245767 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1775ae5-c410-4c38-b70c-e40678593dfb tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:37.246186 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1775ae5-c410-4c38-b70c-e40678593dfb tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:37.332912 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a1775ae5-c410-4c38-b70c-e40678593dfb tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:37.342167 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a1775ae5-c410-4c38-b70c-e40678593dfb tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1301 microversion: 2.1 time: 0.112518 Aug 26 15:55:37.342465 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-74a1fd9c-f168-49b0-b284-c529da36f4b9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:37.343494 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 339/669] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:37 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1301 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:37.360039 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-74a1fd9c-f168-49b0-b284-c529da36f4b9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1508 microversion: 2.1 time: 0.205638 Aug 26 15:55:37.360735 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 331/670] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:37 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:38.249929 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a336030d-f877-413f-923b-4817df536d01 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:38.251145 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a336030d-f877-413f-923b-4817df536d01 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:38.257227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a336030d-f877-413f-923b-4817df536d01 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:38.257914 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a336030d-f877-413f-923b-4817df536d01 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:38.258351 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a336030d-f877-413f-923b-4817df536d01 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:38.259211 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a336030d-f877-413f-923b-4817df536d01 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:38.259667 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a336030d-f877-413f-923b-4817df536d01 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:38.260117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a336030d-f877-413f-923b-4817df536d01 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:38.408200 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-dc4c6cb9-0456-4b23-be45-55a4298138cc req-2c06acba-02b8-4e46-b4d2-d3b4f1cc73a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d429ff90-f8c3-47df-8bde-884a597251d6", "name": "network-vif-deleted", "tag": "c56e18a2-a1c2-4bab-afa7-6e0bbf18ac6c"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:38.419713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-dc4c6cb9-0456-4b23-be45-55a4298138cc req-2c06acba-02b8-4e46-b4d2-d3b4f1cc73a2 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:38.420496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-dc4c6cb9-0456-4b23-be45-55a4298138cc req-2c06acba-02b8-4e46-b4d2-d3b4f1cc73a2 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:38.420992 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-dc4c6cb9-0456-4b23-be45-55a4298138cc req-2c06acba-02b8-4e46-b4d2-d3b4f1cc73a2 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:38.432788 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-dc4c6cb9-0456-4b23-be45-55a4298138cc req-2c06acba-02b8-4e46-b4d2-d3b4f1cc73a2 service nova] Creating event network-vif-deleted:c56e18a2-a1c2-4bab-afa7-6e0bbf18ac6c for instance d429ff90-f8c3-47df-8bde-884a597251d6 on hv-cinder-83124 Aug 26 15:55:38.441290 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-dc4c6cb9-0456-4b23-be45-55a4298138cc req-2c06acba-02b8-4e46-b4d2-d3b4f1cc73a2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150471 Aug 26 15:55:38.442870 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 332/671] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:55:38.448469 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-367714fc-4a85-4c6b-9d7e-92fac9a82f29 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:38.449164 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-367714fc-4a85-4c6b-9d7e-92fac9a82f29 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:38.455506 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-367714fc-4a85-4c6b-9d7e-92fac9a82f29 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:38.456066 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-367714fc-4a85-4c6b-9d7e-92fac9a82f29 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:38.456513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-367714fc-4a85-4c6b-9d7e-92fac9a82f29 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:38.457204 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-367714fc-4a85-4c6b-9d7e-92fac9a82f29 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:38.458221 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-367714fc-4a85-4c6b-9d7e-92fac9a82f29 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:38.458641 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-367714fc-4a85-4c6b-9d7e-92fac9a82f29 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:38.462414 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a336030d-f877-413f-923b-4817df536d01 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:38.476036 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a336030d-f877-413f-923b-4817df536d01 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1756 microversion: 2.1 time: 0.229724 Aug 26 15:55:38.477199 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 340/672] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:38 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1756 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:38.482065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-fadcac15-547c-440b-a63c-84e4cabb4e05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:38.482658 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-fadcac15-547c-440b-a63c-84e4cabb4e05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:38.488802 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fadcac15-547c-440b-a63c-84e4cabb4e05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:38.489277 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fadcac15-547c-440b-a63c-84e4cabb4e05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:38.489708 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fadcac15-547c-440b-a63c-84e4cabb4e05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:38.490486 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fadcac15-547c-440b-a63c-84e4cabb4e05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:38.490929 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fadcac15-547c-440b-a63c-84e4cabb4e05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:38.491854 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fadcac15-547c-440b-a63c-84e4cabb4e05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:38.576220 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-367714fc-4a85-4c6b-9d7e-92fac9a82f29 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:38.590777 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-367714fc-4a85-4c6b-9d7e-92fac9a82f29 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1299 microversion: 2.1 time: 0.146459 Aug 26 15:55:38.592848 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 333/673] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:38 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:38.606224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-fadcac15-547c-440b-a63c-84e4cabb4e05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:38.615714 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-fadcac15-547c-440b-a63c-84e4cabb4e05 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1293 microversion: 2.1 time: 0.137073 Aug 26 15:55:38.616401 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 341/674] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:38 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1293 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:39.501846 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0d35fe3b-d9f2-4598-a6bd-526f5d4c8b37 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:39.502470 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0d35fe3b-d9f2-4598-a6bd-526f5d4c8b37 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:39.511935 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d35fe3b-d9f2-4598-a6bd-526f5d4c8b37 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:39.513486 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d35fe3b-d9f2-4598-a6bd-526f5d4c8b37 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:39.514524 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d35fe3b-d9f2-4598-a6bd-526f5d4c8b37 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:39.515895 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d35fe3b-d9f2-4598-a6bd-526f5d4c8b37 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:39.516887 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d35fe3b-d9f2-4598-a6bd-526f5d4c8b37 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:39.517852 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0d35fe3b-d9f2-4598-a6bd-526f5d4c8b37 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:39.539714 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:55:39.612031 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0edba422-a0ba-498d-97ed-ce1f758a10cd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:39.612749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0edba422-a0ba-498d-97ed-ce1f758a10cd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:39.619753 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0edba422-a0ba-498d-97ed-ce1f758a10cd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:39.620383 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0edba422-a0ba-498d-97ed-ce1f758a10cd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:39.621553 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0edba422-a0ba-498d-97ed-ce1f758a10cd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:39.621553 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0edba422-a0ba-498d-97ed-ce1f758a10cd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:39.621925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0edba422-a0ba-498d-97ed-ce1f758a10cd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:39.622345 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0edba422-a0ba-498d-97ed-ce1f758a10cd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:39.626454 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:55:39.734217 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0d35fe3b-d9f2-4598-a6bd-526f5d4c8b37 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:39.743522 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0d35fe3b-d9f2-4598-a6bd-526f5d4c8b37 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1756 microversion: 2.1 time: 0.246793 Aug 26 15:55:39.753312 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 334/675] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:39 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1756 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:39.759859 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-33395276-463c-416b-a9f7-949d46c15273 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:39.760648 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-33395276-463c-416b-a9f7-949d46c15273 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:39.767527 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-33395276-463c-416b-a9f7-949d46c15273 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:39.768449 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-33395276-463c-416b-a9f7-949d46c15273 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:39.768966 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-33395276-463c-416b-a9f7-949d46c15273 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:39.769831 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-33395276-463c-416b-a9f7-949d46c15273 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:39.770364 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-33395276-463c-416b-a9f7-949d46c15273 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:39.771015 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-33395276-463c-416b-a9f7-949d46c15273 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:39.775111 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0edba422-a0ba-498d-97ed-ce1f758a10cd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:39.782648 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0edba422-a0ba-498d-97ed-ce1f758a10cd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1367 microversion: 2.1 time: 0.174450 Aug 26 15:55:39.783777 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 342/676] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:39 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:39.804092 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-33395276-463c-416b-a9f7-949d46c15273 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:39.804580 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-33395276-463c-416b-a9f7-949d46c15273 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:39.805010 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-33395276-463c-416b-a9f7-949d46c15273 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:39.805460 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-33395276-463c-416b-a9f7-949d46c15273 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lazy-loading 'fault' on Instance uuid d429ff90-f8c3-47df-8bde-884a597251d6 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:55:39.863392 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-33395276-463c-416b-a9f7-949d46c15273 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:39.871229 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-33395276-463c-416b-a9f7-949d46c15273 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 200 len: 1312 microversion: 2.1 time: 0.115808 Aug 26 15:55:39.871850 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 335/677] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:39 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 1312 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:40.482101 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-d049eff0-45d1-458a-9600-dd7599b40513 req-a07ecff3-29cf-4f38-b945-09f4a3112fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f30ecf-6ee4-4098-862e-3f5b5620b188", "tag": "bc49cf78-376c-4f7e-999a-0d25675122ef"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:40.492697 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-d049eff0-45d1-458a-9600-dd7599b40513 req-a07ecff3-29cf-4f38-b945-09f4a3112fd6 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:40.493171 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-d049eff0-45d1-458a-9600-dd7599b40513 req-a07ecff3-29cf-4f38-b945-09f4a3112fd6 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:40.495119 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-d049eff0-45d1-458a-9600-dd7599b40513 req-a07ecff3-29cf-4f38-b945-09f4a3112fd6 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:40.504534 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-d049eff0-45d1-458a-9600-dd7599b40513 req-a07ecff3-29cf-4f38-b945-09f4a3112fd6 service nova] Creating event network-changed:bc49cf78-376c-4f7e-999a-0d25675122ef for instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 on hv-cinder-83124 Aug 26 15:55:40.509290 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-d049eff0-45d1-458a-9600-dd7599b40513 req-a07ecff3-29cf-4f38-b945-09f4a3112fd6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031174 Aug 26 15:55:40.510070 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 343/678] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:40.767757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-aec65471-ae73-4208-836d-7882cdea665f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:40.768358 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-aec65471-ae73-4208-836d-7882cdea665f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:40.775949 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aec65471-ae73-4208-836d-7882cdea665f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:40.776464 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aec65471-ae73-4208-836d-7882cdea665f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:40.776902 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aec65471-ae73-4208-836d-7882cdea665f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:40.777596 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aec65471-ae73-4208-836d-7882cdea665f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:40.778053 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aec65471-ae73-4208-836d-7882cdea665f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:40.778522 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aec65471-ae73-4208-836d-7882cdea665f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:40.805082 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5ef27203-2057-4e11-b362-705f7400628d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:40.805814 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5ef27203-2057-4e11-b362-705f7400628d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:40.812862 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5ef27203-2057-4e11-b362-705f7400628d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:40.813348 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5ef27203-2057-4e11-b362-705f7400628d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:40.813970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5ef27203-2057-4e11-b362-705f7400628d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:40.814669 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5ef27203-2057-4e11-b362-705f7400628d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:40.815115 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5ef27203-2057-4e11-b362-705f7400628d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:40.815544 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5ef27203-2057-4e11-b362-705f7400628d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:40.930105 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-aec65471-ae73-4208-836d-7882cdea665f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:40.938806 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-aec65471-ae73-4208-836d-7882cdea665f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1756 microversion: 2.1 time: 0.177551 Aug 26 15:55:40.939379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 336/679] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:40 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:40.947723 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a6f77f65-4171-4357-bce1-12859e89b8a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:40.953811 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a6f77f65-4171-4357-bce1-12859e89b8a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: d429ff90-f8c3-47df-8bde-884a597251d6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:40.960703 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a6f77f65-4171-4357-bce1-12859e89b8a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:40.961371 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a6f77f65-4171-4357-bce1-12859e89b8a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:40.964787 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a6f77f65-4171-4357-bce1-12859e89b8a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:40.964787 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a6f77f65-4171-4357-bce1-12859e89b8a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:40.964787 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a6f77f65-4171-4357-bce1-12859e89b8a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:40.964787 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a6f77f65-4171-4357-bce1-12859e89b8a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:40.965927 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5ef27203-2057-4e11-b362-705f7400628d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:40.974742 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5ef27203-2057-4e11-b362-705f7400628d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1367 microversion: 2.1 time: 0.174446 Aug 26 15:55:40.975511 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 344/680] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:40 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-a6f77f65-4171-4357-bce1-12859e89b8a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] HTTP exception thrown: Instance d429ff90-f8c3-47df-8bde-884a597251d6 could not be found. Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a6f77f65-4171-4357-bce1-12859e89b8a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Request method failure captured: Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 HTTP/1.1 Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOu4mB4haQKordFhuZBlwEB2sjzB1Ggq0RGqd_gZMlk7fOoxmsTjHxDr7EkB7u8NObi4d6APbLdClBiJmlJAqHVshko5l_rzaX5t4_54zFPQBeYab44MgJPCU1k-0j6OBkr3q7IvEClkDHMwJxZPzPX7sgNHTQ4qdi7FVVy-db3TXrw Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: 853df33daae14bd9825788afd555e11a Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1564618252 Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:55:40.982937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:55:40.984678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/853df33daae14bd9825788afd555e11a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_853df33daae14bd9825788afd555e11a", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/853df33daae14bd9825788afd555e11a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/853df33daae14bd9825788afd555e11a"}]}] Aug 26 15:55:40.984678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1564618252 Aug 26 15:55:40.984678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: 853df33daae14bd9825788afd555e11a Aug 26 15:55:40.984678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1564618252 Aug 26 15:55:40.984678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-ServerRescueNegativeTestJSON-1564618252-project Aug 26 15:55:40.984678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:55:40.984678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:55:40.984678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 5c01a893d3ab42cc97508768791ff38e Aug 26 15:55:40.984678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1564618252-project Aug 26 15:55:40.984678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:55:40.984678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance d429ff90-f8c3-47df-8bde-884a597251d6 could not be found. Aug 26 15:55:40.984678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': 'd429ff90-f8c3-47df-8bde-884a597251d6'} Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d429ff90-f8c3-47df-8bde-884a597251d6 could not be found. Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:55:40.985565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d429ff90-f8c3-47df-8bde-884a597251d6 could not be found. Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d429ff90-f8c3-47df-8bde-884a597251d6 could not be found. Aug 26 15:55:40.986993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:40.988313 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a6f77f65-4171-4357-bce1-12859e89b8a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Returning 404 to user: Instance d429ff90-f8c3-47df-8bde-884a597251d6 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:55:40.988313 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-a6f77f65-4171-4357-bce1-12859e89b8a2 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6" status: 404 len: 111 microversion: 2.1 time: 0.040550 Aug 26 15:55:40.988313 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 337/681] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:40 2022] GET /compute/v2.1/servers/d429ff90-f8c3-47df-8bde-884a597251d6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:55:40.990295 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d1339a48-826f-4cbf-b423-5f625c2e2e7b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:40.990777 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d1339a48-826f-4cbf-b423-5f625c2e2e7b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:40.996470 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d1339a48-826f-4cbf-b423-5f625c2e2e7b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:41.010632 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d1339a48-826f-4cbf-b423-5f625c2e2e7b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:41.010632 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d1339a48-826f-4cbf-b423-5f625c2e2e7b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:41.010632 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d1339a48-826f-4cbf-b423-5f625c2e2e7b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:41.010632 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d1339a48-826f-4cbf-b423-5f625c2e2e7b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:41.011007 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d1339a48-826f-4cbf-b423-5f625c2e2e7b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:41.023774 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d1339a48-826f-4cbf-b423-5f625c2e2e7b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Going to try to terminate instance {{(pid=127698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:55:41.373641 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d1339a48-826f-4cbf-b423-5f625c2e2e7b tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "DELETE /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 204 len: 0 microversion: 2.1 time: 0.386408 Aug 26 15:55:41.374188 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 338/682] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:55:40 2022] DELETE /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:55:41.382736 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a6ea1948-339e-4e81-889e-3e08fe6ad607 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:41.383385 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a6ea1948-339e-4e81-889e-3e08fe6ad607 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:41.389522 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a6ea1948-339e-4e81-889e-3e08fe6ad607 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:41.389998 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a6ea1948-339e-4e81-889e-3e08fe6ad607 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:41.390442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a6ea1948-339e-4e81-889e-3e08fe6ad607 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:41.391120 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a6ea1948-339e-4e81-889e-3e08fe6ad607 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:41.391569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a6ea1948-339e-4e81-889e-3e08fe6ad607 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:41.392019 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a6ea1948-339e-4e81-889e-3e08fe6ad607 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:41.523475 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a6ea1948-339e-4e81-889e-3e08fe6ad607 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:41.531545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a6ea1948-339e-4e81-889e-3e08fe6ad607 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.153156 Aug 26 15:55:41.532146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 345/683] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:41 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:41.961905 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0379c341-1751-4a02-b33c-5e13d74de1e8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:41.962635 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0379c341-1751-4a02-b33c-5e13d74de1e8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:41.964572 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:55:41.965255 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=6 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:55:41.970383 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0379c341-1751-4a02-b33c-5e13d74de1e8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:41.970857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0379c341-1751-4a02-b33c-5e13d74de1e8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:41.971292 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0379c341-1751-4a02-b33c-5e13d74de1e8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:41.972037 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0379c341-1751-4a02-b33c-5e13d74de1e8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:41.972488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0379c341-1751-4a02-b33c-5e13d74de1e8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:41.972908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0379c341-1751-4a02-b33c-5e13d74de1e8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:41.995754 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a130dd53-553f-49e7-a0e3-e99f15e0f952 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:42.000916 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a130dd53-553f-49e7-a0e3-e99f15e0f952 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:42.000916 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=6 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:55:42.005209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a130dd53-553f-49e7-a0e3-e99f15e0f952 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:42.005209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a130dd53-553f-49e7-a0e3-e99f15e0f952 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:42.005209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a130dd53-553f-49e7-a0e3-e99f15e0f952 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:42.005609 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a130dd53-553f-49e7-a0e3-e99f15e0f952 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:42.006015 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a130dd53-553f-49e7-a0e3-e99f15e0f952 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:42.006613 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a130dd53-553f-49e7-a0e3-e99f15e0f952 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:42.126882 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0379c341-1751-4a02-b33c-5e13d74de1e8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:42.136372 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0379c341-1751-4a02-b33c-5e13d74de1e8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1756 microversion: 2.1 time: 0.179183 Aug 26 15:55:42.137226 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 339/684] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:41 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:42.153492 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a130dd53-553f-49e7-a0e3-e99f15e0f952 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:42.163722 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a130dd53-553f-49e7-a0e3-e99f15e0f952 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1367 microversion: 2.1 time: 0.171605 Aug 26 15:55:42.164392 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 346/685] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:41 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:42.553226 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-28241511-9f5b-4629-998d-0f61d37a192e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:42.553892 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-28241511-9f5b-4629-998d-0f61d37a192e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:42.559850 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28241511-9f5b-4629-998d-0f61d37a192e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:42.560372 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28241511-9f5b-4629-998d-0f61d37a192e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:42.560809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28241511-9f5b-4629-998d-0f61d37a192e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:42.561501 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28241511-9f5b-4629-998d-0f61d37a192e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:42.561956 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28241511-9f5b-4629-998d-0f61d37a192e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:42.562380 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28241511-9f5b-4629-998d-0f61d37a192e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:42.712315 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-28241511-9f5b-4629-998d-0f61d37a192e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:42.720231 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-28241511-9f5b-4629-998d-0f61d37a192e tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.171375 Aug 26 15:55:42.720801 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 340/686] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:42 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:43.166464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1f0b568e-c434-402a-8b01-dde968c3c5aa tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:43.167325 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1f0b568e-c434-402a-8b01-dde968c3c5aa tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:43.175148 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f0b568e-c434-402a-8b01-dde968c3c5aa tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:43.175624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f0b568e-c434-402a-8b01-dde968c3c5aa tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:43.176103 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f0b568e-c434-402a-8b01-dde968c3c5aa tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:43.176804 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f0b568e-c434-402a-8b01-dde968c3c5aa tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:43.177251 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f0b568e-c434-402a-8b01-dde968c3c5aa tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:43.177680 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1f0b568e-c434-402a-8b01-dde968c3c5aa tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:43.184102 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d05dd332-8000-49c2-844b-bbdd8c4ff578 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:43.184721 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d05dd332-8000-49c2-844b-bbdd8c4ff578 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:43.191788 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d05dd332-8000-49c2-844b-bbdd8c4ff578 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:43.192324 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d05dd332-8000-49c2-844b-bbdd8c4ff578 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:43.192764 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d05dd332-8000-49c2-844b-bbdd8c4ff578 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:43.193466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d05dd332-8000-49c2-844b-bbdd8c4ff578 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:43.193938 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d05dd332-8000-49c2-844b-bbdd8c4ff578 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:43.194341 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d05dd332-8000-49c2-844b-bbdd8c4ff578 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:43.324256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1f0b568e-c434-402a-8b01-dde968c3c5aa tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:43.330750 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d05dd332-8000-49c2-844b-bbdd8c4ff578 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:43.333483 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1f0b568e-c434-402a-8b01-dde968c3c5aa tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1756 microversion: 2.1 time: 0.173608 Aug 26 15:55:43.334370 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 347/687] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:43 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:43.339342 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d05dd332-8000-49c2-844b-bbdd8c4ff578 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1367 microversion: 2.1 time: 0.159149 Aug 26 15:55:43.339927 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 341/688] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:43 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:43.743942 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-30fe3c6d-f766-40a0-b8fd-99832208cfc9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:43.744601 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-30fe3c6d-f766-40a0-b8fd-99832208cfc9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:43.751037 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-30fe3c6d-f766-40a0-b8fd-99832208cfc9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:43.751555 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-30fe3c6d-f766-40a0-b8fd-99832208cfc9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:43.752057 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-30fe3c6d-f766-40a0-b8fd-99832208cfc9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:43.752793 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-30fe3c6d-f766-40a0-b8fd-99832208cfc9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:43.753284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-30fe3c6d-f766-40a0-b8fd-99832208cfc9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:43.759751 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-30fe3c6d-f766-40a0-b8fd-99832208cfc9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:43.886347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-30fe3c6d-f766-40a0-b8fd-99832208cfc9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:43.893979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-30fe3c6d-f766-40a0-b8fd-99832208cfc9 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.154814 Aug 26 15:55:43.894553 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 348/689] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:43 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:44.355839 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d5de9527-b0c1-4593-8c2f-242840b2413e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:44.357101 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d5de9527-b0c1-4593-8c2f-242840b2413e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:44.361621 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-60b3dcf3-f390-4035-86c5-6305ae8bdd09 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:44.362679 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-60b3dcf3-f390-4035-86c5-6305ae8bdd09 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:44.365368 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d5de9527-b0c1-4593-8c2f-242840b2413e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:44.366018 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d5de9527-b0c1-4593-8c2f-242840b2413e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:44.366406 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d5de9527-b0c1-4593-8c2f-242840b2413e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:44.367160 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d5de9527-b0c1-4593-8c2f-242840b2413e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:44.367631 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d5de9527-b0c1-4593-8c2f-242840b2413e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:44.368124 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d5de9527-b0c1-4593-8c2f-242840b2413e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:44.368848 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-60b3dcf3-f390-4035-86c5-6305ae8bdd09 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:44.369326 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-60b3dcf3-f390-4035-86c5-6305ae8bdd09 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:44.369947 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-60b3dcf3-f390-4035-86c5-6305ae8bdd09 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:44.370696 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-60b3dcf3-f390-4035-86c5-6305ae8bdd09 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:44.371182 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-60b3dcf3-f390-4035-86c5-6305ae8bdd09 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:44.371825 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-60b3dcf3-f390-4035-86c5-6305ae8bdd09 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:44.510379 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-60b3dcf3-f390-4035-86c5-6305ae8bdd09 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:44.518727 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-60b3dcf3-f390-4035-86c5-6305ae8bdd09 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1367 microversion: 2.1 time: 0.161712 Aug 26 15:55:44.522338 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d5de9527-b0c1-4593-8c2f-242840b2413e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:44.522539 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 349/690] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:44 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:44.530820 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d5de9527-b0c1-4593-8c2f-242840b2413e tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1756 microversion: 2.1 time: 0.179381 Aug 26 15:55:44.531379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 342/691] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:44 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:44.915211 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c331ac29-a9fe-4585-b6fc-a4f06dd00364 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:44.915736 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c331ac29-a9fe-4585-b6fc-a4f06dd00364 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:44.921826 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c331ac29-a9fe-4585-b6fc-a4f06dd00364 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:44.922329 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c331ac29-a9fe-4585-b6fc-a4f06dd00364 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:44.922801 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c331ac29-a9fe-4585-b6fc-a4f06dd00364 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:44.923534 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c331ac29-a9fe-4585-b6fc-a4f06dd00364 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:44.924032 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c331ac29-a9fe-4585-b6fc-a4f06dd00364 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:44.924495 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c331ac29-a9fe-4585-b6fc-a4f06dd00364 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:45.054625 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c331ac29-a9fe-4585-b6fc-a4f06dd00364 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:45.062257 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c331ac29-a9fe-4585-b6fc-a4f06dd00364 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.151590 Aug 26 15:55:45.062819 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 350/692] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:44 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:45.541429 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-17ca5e46-ce3a-47ac-9cac-5dbb63a78b65 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:45.542207 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-17ca5e46-ce3a-47ac-9cac-5dbb63a78b65 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:45.549498 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-17ca5e46-ce3a-47ac-9cac-5dbb63a78b65 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:45.549988 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-17ca5e46-ce3a-47ac-9cac-5dbb63a78b65 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:45.550421 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-17ca5e46-ce3a-47ac-9cac-5dbb63a78b65 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:45.551156 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-17ca5e46-ce3a-47ac-9cac-5dbb63a78b65 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:45.551344 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c6f1c813-1d5c-481c-869f-3f84163ce057 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:45.551794 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-17ca5e46-ce3a-47ac-9cac-5dbb63a78b65 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:45.551984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c6f1c813-1d5c-481c-869f-3f84163ce057 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:45.552104 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-17ca5e46-ce3a-47ac-9cac-5dbb63a78b65 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:45.558767 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c6f1c813-1d5c-481c-869f-3f84163ce057 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:45.559256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c6f1c813-1d5c-481c-869f-3f84163ce057 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:45.559687 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c6f1c813-1d5c-481c-869f-3f84163ce057 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:45.560451 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c6f1c813-1d5c-481c-869f-3f84163ce057 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:45.561092 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c6f1c813-1d5c-481c-869f-3f84163ce057 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:45.562007 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c6f1c813-1d5c-481c-869f-3f84163ce057 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:45.686437 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-17ca5e46-ce3a-47ac-9cac-5dbb63a78b65 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:45.694650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-17ca5e46-ce3a-47ac-9cac-5dbb63a78b65 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1367 microversion: 2.1 time: 0.157753 Aug 26 15:55:45.695219 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 343/693] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:45 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:45.713489 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c6f1c813-1d5c-481c-869f-3f84163ce057 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:45.721688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c6f1c813-1d5c-481c-869f-3f84163ce057 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1756 microversion: 2.1 time: 0.174226 Aug 26 15:55:45.722245 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 351/694] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:45 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:45.768876 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d9318970-ead6-4316-af6e-5910bc0c1853 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:45.769494 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d9318970-ead6-4316-af6e-5910bc0c1853 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:45.776336 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d9318970-ead6-4316-af6e-5910bc0c1853 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:45.776815 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d9318970-ead6-4316-af6e-5910bc0c1853 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:45.777274 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d9318970-ead6-4316-af6e-5910bc0c1853 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:45.777961 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d9318970-ead6-4316-af6e-5910bc0c1853 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:45.778432 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d9318970-ead6-4316-af6e-5910bc0c1853 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:45.778851 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d9318970-ead6-4316-af6e-5910bc0c1853 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:45.803172 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d9318970-ead6-4316-af6e-5910bc0c1853 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Going to try to terminate instance {{(pid=127698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:55:46.005208 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:55:46.070319 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d9318970-ead6-4316-af6e-5910bc0c1853 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "DELETE /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 204 len: 0 microversion: 2.1 time: 0.305983 Aug 26 15:55:46.070837 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 344/695] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:55:45 2022] DELETE /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:55:46.079227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-16c382ba-296b-4e6e-b88f-b981bb7c7d46 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:46.079836 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-16c382ba-296b-4e6e-b88f-b981bb7c7d46 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:46.082638 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ac188a14-b627-46ed-aa55-f1f47dbd2460 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:46.083349 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ac188a14-b627-46ed-aa55-f1f47dbd2460 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:46.085996 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-16c382ba-296b-4e6e-b88f-b981bb7c7d46 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:46.086488 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-16c382ba-296b-4e6e-b88f-b981bb7c7d46 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:46.086921 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-16c382ba-296b-4e6e-b88f-b981bb7c7d46 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:46.087698 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-16c382ba-296b-4e6e-b88f-b981bb7c7d46 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:46.088183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-16c382ba-296b-4e6e-b88f-b981bb7c7d46 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:46.088604 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-16c382ba-296b-4e6e-b88f-b981bb7c7d46 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:46.089047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ac188a14-b627-46ed-aa55-f1f47dbd2460 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:46.089532 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ac188a14-b627-46ed-aa55-f1f47dbd2460 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:46.089971 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ac188a14-b627-46ed-aa55-f1f47dbd2460 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:46.090665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ac188a14-b627-46ed-aa55-f1f47dbd2460 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:46.091120 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ac188a14-b627-46ed-aa55-f1f47dbd2460 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:46.091554 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ac188a14-b627-46ed-aa55-f1f47dbd2460 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:46.233535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ac188a14-b627-46ed-aa55-f1f47dbd2460 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:46.241792 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ac188a14-b627-46ed-aa55-f1f47dbd2460 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.163146 Aug 26 15:55:46.242368 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 345/696] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:46 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:46.244598 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-16c382ba-296b-4e6e-b88f-b981bb7c7d46 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:46.252405 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-16c382ba-296b-4e6e-b88f-b981bb7c7d46 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1575 microversion: 2.1 time: 0.177072 Aug 26 15:55:46.253746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 352/697] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:46 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:46.716448 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8d89bd08-03f5-46c6-b5c8-fcb57a3d429b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:46.717095 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-8d89bd08-03f5-46c6-b5c8-fcb57a3d429b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:46.724598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8d89bd08-03f5-46c6-b5c8-fcb57a3d429b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:46.725089 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8d89bd08-03f5-46c6-b5c8-fcb57a3d429b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:46.725524 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8d89bd08-03f5-46c6-b5c8-fcb57a3d429b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:46.726220 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8d89bd08-03f5-46c6-b5c8-fcb57a3d429b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:46.726673 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8d89bd08-03f5-46c6-b5c8-fcb57a3d429b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:46.727094 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8d89bd08-03f5-46c6-b5c8-fcb57a3d429b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:46.743564 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-596ae441-1927-4a63-a5cd-af635a1180e0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:46.744317 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-596ae441-1927-4a63-a5cd-af635a1180e0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:46.751521 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-596ae441-1927-4a63-a5cd-af635a1180e0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:46.752183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-596ae441-1927-4a63-a5cd-af635a1180e0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:46.752738 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-596ae441-1927-4a63-a5cd-af635a1180e0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:46.753569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-596ae441-1927-4a63-a5cd-af635a1180e0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:46.754118 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-596ae441-1927-4a63-a5cd-af635a1180e0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:46.754665 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-596ae441-1927-4a63-a5cd-af635a1180e0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:46.879624 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8d89bd08-03f5-46c6-b5c8-fcb57a3d429b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:46.888490 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-8d89bd08-03f5-46c6-b5c8-fcb57a3d429b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1367 microversion: 2.1 time: 0.176098 Aug 26 15:55:46.889275 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 346/698] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:46 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:46.921028 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-596ae441-1927-4a63-a5cd-af635a1180e0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:46.929497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-596ae441-1927-4a63-a5cd-af635a1180e0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1756 microversion: 2.1 time: 0.190653 Aug 26 15:55:46.930091 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 353/699] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:46 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:47.235049 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-7a960d5a-e140-4278-bc40-d43343234b85 req-90d7a616-c9fc-4de9-8b86-0e9acc1769a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f30ecf-6ee4-4098-862e-3f5b5620b188", "name": "network-vif-plugged", "status": "completed", "tag": "bc49cf78-376c-4f7e-999a-0d25675122ef"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:47.246664 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-7a960d5a-e140-4278-bc40-d43343234b85 req-90d7a616-c9fc-4de9-8b86-0e9acc1769a7 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:47.247184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-7a960d5a-e140-4278-bc40-d43343234b85 req-90d7a616-c9fc-4de9-8b86-0e9acc1769a7 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:47.247690 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-7a960d5a-e140-4278-bc40-d43343234b85 req-90d7a616-c9fc-4de9-8b86-0e9acc1769a7 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:47.262230 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-7a960d5a-e140-4278-bc40-d43343234b85 req-90d7a616-c9fc-4de9-8b86-0e9acc1769a7 service nova] Creating event network-vif-plugged:bc49cf78-376c-4f7e-999a-0d25675122ef for instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 on hv-cinder-83124 Aug 26 15:55:47.266616 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-370eff03-05a4-4de2-a142-1ad51d854351 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:47.267566 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-370eff03-05a4-4de2-a142-1ad51d854351 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:47.271582 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-7a960d5a-e140-4278-bc40-d43343234b85 req-90d7a616-c9fc-4de9-8b86-0e9acc1769a7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041133 Aug 26 15:55:47.272536 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 347/700] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:55:47.277868 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-370eff03-05a4-4de2-a142-1ad51d854351 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:47.278634 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-370eff03-05a4-4de2-a142-1ad51d854351 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:47.279333 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-370eff03-05a4-4de2-a142-1ad51d854351 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:47.280492 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-370eff03-05a4-4de2-a142-1ad51d854351 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:47.281771 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4b5d5d4d-3ecf-450d-a3cc-cfd3767018ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:47.281921 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-370eff03-05a4-4de2-a142-1ad51d854351 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:47.281921 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-370eff03-05a4-4de2-a142-1ad51d854351 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:47.282299 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-4b5d5d4d-3ecf-450d-a3cc-cfd3767018ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:47.291594 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b5d5d4d-3ecf-450d-a3cc-cfd3767018ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:47.292121 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b5d5d4d-3ecf-450d-a3cc-cfd3767018ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:47.292556 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b5d5d4d-3ecf-450d-a3cc-cfd3767018ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:47.293273 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b5d5d4d-3ecf-450d-a3cc-cfd3767018ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:47.293701 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b5d5d4d-3ecf-450d-a3cc-cfd3767018ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:47.294117 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b5d5d4d-3ecf-450d-a3cc-cfd3767018ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:47.464370 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-370eff03-05a4-4de2-a142-1ad51d854351 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:47.471699 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-370eff03-05a4-4de2-a142-1ad51d854351 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.211632 Aug 26 15:55:47.472312 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 354/701] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:47 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:47.475993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4b5d5d4d-3ecf-450d-a3cc-cfd3767018ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:47.480061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:55:47.485998 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4b5d5d4d-3ecf-450d-a3cc-cfd3767018ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1575 microversion: 2.1 time: 0.211887 Aug 26 15:55:47.486743 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 348/702] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:47 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:47.910292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-57527019-d66a-4f1f-996e-98462bfa04a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:47.911393 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-57527019-d66a-4f1f-996e-98462bfa04a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:47.917833 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57527019-d66a-4f1f-996e-98462bfa04a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:47.918301 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57527019-d66a-4f1f-996e-98462bfa04a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:47.918727 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57527019-d66a-4f1f-996e-98462bfa04a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:47.919404 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57527019-d66a-4f1f-996e-98462bfa04a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:47.919898 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57527019-d66a-4f1f-996e-98462bfa04a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:47.920318 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57527019-d66a-4f1f-996e-98462bfa04a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:47.957257 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2079d351-b9ec-4803-a6ff-52dc26c654db tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:47.957931 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2079d351-b9ec-4803-a6ff-52dc26c654db tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:47.965195 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2079d351-b9ec-4803-a6ff-52dc26c654db tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:47.965678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2079d351-b9ec-4803-a6ff-52dc26c654db tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:47.966109 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2079d351-b9ec-4803-a6ff-52dc26c654db tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:47.966811 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2079d351-b9ec-4803-a6ff-52dc26c654db tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:47.967258 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2079d351-b9ec-4803-a6ff-52dc26c654db tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:47.967678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2079d351-b9ec-4803-a6ff-52dc26c654db tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:48.055759 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-57527019-d66a-4f1f-996e-98462bfa04a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:48.063957 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-57527019-d66a-4f1f-996e-98462bfa04a6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1367 microversion: 2.1 time: 0.157310 Aug 26 15:55:48.064779 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 355/703] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:47 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:48.129365 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2079d351-b9ec-4803-a6ff-52dc26c654db tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:48.133033 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2079d351-b9ec-4803-a6ff-52dc26c654db tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1756 microversion: 2.1 time: 0.179555 Aug 26 15:55:48.133602 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 349/704] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:47 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:48.493490 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e7301faa-e4df-4dc9-bd53-e1bc0b4145c8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:48.494097 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e7301faa-e4df-4dc9-bd53-e1bc0b4145c8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:48.500101 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e7301faa-e4df-4dc9-bd53-e1bc0b4145c8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:48.500584 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e7301faa-e4df-4dc9-bd53-e1bc0b4145c8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:48.501017 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e7301faa-e4df-4dc9-bd53-e1bc0b4145c8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:48.501795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e7301faa-e4df-4dc9-bd53-e1bc0b4145c8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:48.502299 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e7301faa-e4df-4dc9-bd53-e1bc0b4145c8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:48.502653 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e7301faa-e4df-4dc9-bd53-e1bc0b4145c8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:48.506913 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-914606f2-16b5-4eac-86e3-de00a6eded04 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:48.507528 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-914606f2-16b5-4eac-86e3-de00a6eded04 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:48.513726 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-914606f2-16b5-4eac-86e3-de00a6eded04 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:48.517717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-914606f2-16b5-4eac-86e3-de00a6eded04 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:48.517717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-914606f2-16b5-4eac-86e3-de00a6eded04 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:48.517717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-914606f2-16b5-4eac-86e3-de00a6eded04 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:48.517717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-914606f2-16b5-4eac-86e3-de00a6eded04 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:48.518121 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-914606f2-16b5-4eac-86e3-de00a6eded04 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:48.654045 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e7301faa-e4df-4dc9-bd53-e1bc0b4145c8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:48.661832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e7301faa-e4df-4dc9-bd53-e1bc0b4145c8 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.171989 Aug 26 15:55:48.662536 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 356/705] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:48 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:48.679838 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-914606f2-16b5-4eac-86e3-de00a6eded04 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:48.685283 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-914606f2-16b5-4eac-86e3-de00a6eded04 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1575 microversion: 2.1 time: 0.182590 Aug 26 15:55:48.686031 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 350/706] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:48 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:49.085651 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c30e51b3-a8d0-4bfc-b182-bf8ee9dcfeb2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:49.086323 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c30e51b3-a8d0-4bfc-b182-bf8ee9dcfeb2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:49.093019 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c30e51b3-a8d0-4bfc-b182-bf8ee9dcfeb2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:49.093502 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c30e51b3-a8d0-4bfc-b182-bf8ee9dcfeb2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:49.094007 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c30e51b3-a8d0-4bfc-b182-bf8ee9dcfeb2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:49.094641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c30e51b3-a8d0-4bfc-b182-bf8ee9dcfeb2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:49.095090 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c30e51b3-a8d0-4bfc-b182-bf8ee9dcfeb2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:49.095512 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c30e51b3-a8d0-4bfc-b182-bf8ee9dcfeb2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:49.154929 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-9073e508-13b5-4ceb-8496-9a0b900655f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:49.155547 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-9073e508-13b5-4ceb-8496-9a0b900655f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:49.162655 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9073e508-13b5-4ceb-8496-9a0b900655f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:49.163895 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9073e508-13b5-4ceb-8496-9a0b900655f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:49.164584 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9073e508-13b5-4ceb-8496-9a0b900655f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:49.165650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9073e508-13b5-4ceb-8496-9a0b900655f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:49.166029 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9073e508-13b5-4ceb-8496-9a0b900655f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:49.166650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9073e508-13b5-4ceb-8496-9a0b900655f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:49.269762 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c30e51b3-a8d0-4bfc-b182-bf8ee9dcfeb2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:49.278280 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c30e51b3-a8d0-4bfc-b182-bf8ee9dcfeb2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1367 microversion: 2.1 time: 0.196962 Aug 26 15:55:49.285070 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 357/707] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:49 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:49.489902 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-9073e508-13b5-4ceb-8496-9a0b900655f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:49.498573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-9073e508-13b5-4ceb-8496-9a0b900655f8 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1756 microversion: 2.1 time: 0.347929 Aug 26 15:55:49.499385 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 351/708] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:49 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1756 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:49.681951 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1b26ddab-f798-4d52-bd35-e51107ba25af tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:49.682916 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1b26ddab-f798-4d52-bd35-e51107ba25af tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:49.689542 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b26ddab-f798-4d52-bd35-e51107ba25af tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:49.690370 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b26ddab-f798-4d52-bd35-e51107ba25af tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:49.690812 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b26ddab-f798-4d52-bd35-e51107ba25af tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:49.691516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b26ddab-f798-4d52-bd35-e51107ba25af tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:49.692734 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b26ddab-f798-4d52-bd35-e51107ba25af tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:49.693703 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b26ddab-f798-4d52-bd35-e51107ba25af tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:49.712132 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-16f501ea-d2f7-4399-92cd-581a1dad831b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:49.722244 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-16f501ea-d2f7-4399-92cd-581a1dad831b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:49.722244 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-16f501ea-d2f7-4399-92cd-581a1dad831b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:49.722244 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-16f501ea-d2f7-4399-92cd-581a1dad831b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:49.722244 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-16f501ea-d2f7-4399-92cd-581a1dad831b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:49.722801 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-16f501ea-d2f7-4399-92cd-581a1dad831b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:49.722801 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-16f501ea-d2f7-4399-92cd-581a1dad831b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:49.722801 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-16f501ea-d2f7-4399-92cd-581a1dad831b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:49.918893 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1b26ddab-f798-4d52-bd35-e51107ba25af tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:49.930945 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1b26ddab-f798-4d52-bd35-e51107ba25af tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1521 microversion: 2.1 time: 0.252783 Aug 26 15:55:49.932931 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 358/709] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:49 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:49.937206 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-f2c780cf-0f0a-49e8-9874-c6caf655374a req-5272d37c-4655-4574-a520-572e1a2b5c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae5c9c4-de22-4f03-a66b-3b0a632131e0", "name": "network-vif-deleted", "tag": "57ccb93e-3e0c-4959-a846-0f9b661425bf"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:49.956554 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-f2c780cf-0f0a-49e8-9874-c6caf655374a req-5272d37c-4655-4574-a520-572e1a2b5c8d service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:49.956721 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-16f501ea-d2f7-4399-92cd-581a1dad831b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:49.959575 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-f2c780cf-0f0a-49e8-9874-c6caf655374a req-5272d37c-4655-4574-a520-572e1a2b5c8d service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:49.960321 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-f2c780cf-0f0a-49e8-9874-c6caf655374a req-5272d37c-4655-4574-a520-572e1a2b5c8d service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:49.966017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-16f501ea-d2f7-4399-92cd-581a1dad831b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1575 microversion: 2.1 time: 0.262713 Aug 26 15:55:49.974586 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-f2c780cf-0f0a-49e8-9874-c6caf655374a req-5272d37c-4655-4574-a520-572e1a2b5c8d service nova] Creating event network-vif-deleted:57ccb93e-3e0c-4959-a846-0f9b661425bf for instance eae5c9c4-de22-4f03-a66b-3b0a632131e0 on hv-cinder-83124 Aug 26 15:55:49.982334 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 352/710] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:49 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1575 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:49.989592 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-f2c780cf-0f0a-49e8-9874-c6caf655374a req-5272d37c-4655-4574-a520-572e1a2b5c8d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051898 Aug 26 15:55:49.989592 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 359/711] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:50.299281 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-39b5fb81-873c-4f27-b75c-dd7631a1ac6a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:50.300604 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-39b5fb81-873c-4f27-b75c-dd7631a1ac6a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:50.307907 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-39b5fb81-873c-4f27-b75c-dd7631a1ac6a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:50.311018 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-39b5fb81-873c-4f27-b75c-dd7631a1ac6a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:50.311018 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-39b5fb81-873c-4f27-b75c-dd7631a1ac6a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:50.311018 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-39b5fb81-873c-4f27-b75c-dd7631a1ac6a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:50.311018 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-39b5fb81-873c-4f27-b75c-dd7631a1ac6a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:50.311431 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-39b5fb81-873c-4f27-b75c-dd7631a1ac6a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:50.456173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-39b5fb81-873c-4f27-b75c-dd7631a1ac6a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:50.467993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-39b5fb81-873c-4f27-b75c-dd7631a1ac6a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1367 microversion: 2.1 time: 0.172642 Aug 26 15:55:50.468933 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 353/712] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:50 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:50.491581 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-4aafb214-99b9-45e1-af92-d5f6f2558988 req-402112ad-223e-4c38-aded-a72caafc6a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "669aaa3a-3cdf-4764-aa7f-38e9cc9e9894", "name": "network-vif-deleted", "tag": "ffc9d75b-ddcb-431d-a99f-fd94fe97633c"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:50.501761 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-4aafb214-99b9-45e1-af92-d5f6f2558988 req-402112ad-223e-4c38-aded-a72caafc6a8c service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:50.502246 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-4aafb214-99b9-45e1-af92-d5f6f2558988 req-402112ad-223e-4c38-aded-a72caafc6a8c service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:50.502873 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-4aafb214-99b9-45e1-af92-d5f6f2558988 req-402112ad-223e-4c38-aded-a72caafc6a8c service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:50.507686 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=100 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:55:50.515760 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-4aafb214-99b9-45e1-af92-d5f6f2558988 req-402112ad-223e-4c38-aded-a72caafc6a8c service nova] Creating event network-vif-deleted:ffc9d75b-ddcb-431d-a99f-fd94fe97633c for instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 on hv-cinder-83124 Aug 26 15:55:50.520160 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-371cd18c-7f2b-43bc-a5a9-4d157dbde8c7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:50.521473 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-371cd18c-7f2b-43bc-a5a9-4d157dbde8c7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:50.522748 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-4aafb214-99b9-45e1-af92-d5f6f2558988 req-402112ad-223e-4c38-aded-a72caafc6a8c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117600 Aug 26 15:55:50.523912 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 360/713] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:50.529215 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-371cd18c-7f2b-43bc-a5a9-4d157dbde8c7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:50.529709 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-371cd18c-7f2b-43bc-a5a9-4d157dbde8c7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:50.530148 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-371cd18c-7f2b-43bc-a5a9-4d157dbde8c7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:50.530888 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-371cd18c-7f2b-43bc-a5a9-4d157dbde8c7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:50.531344 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-371cd18c-7f2b-43bc-a5a9-4d157dbde8c7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:50.531774 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-371cd18c-7f2b-43bc-a5a9-4d157dbde8c7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:50.720172 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-371cd18c-7f2b-43bc-a5a9-4d157dbde8c7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:50.730241 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-371cd18c-7f2b-43bc-a5a9-4d157dbde8c7 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1756 microversion: 2.1 time: 0.214167 Aug 26 15:55:50.732113 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 354/714] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:50 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1756 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:50.955974 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-28164fab-f3e0-4dba-a763-c5a3611ddac0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:50.956982 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-28164fab-f3e0-4dba-a763-c5a3611ddac0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:50.963177 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-28164fab-f3e0-4dba-a763-c5a3611ddac0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:50.963658 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-28164fab-f3e0-4dba-a763-c5a3611ddac0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:50.964123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-28164fab-f3e0-4dba-a763-c5a3611ddac0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:50.964812 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-28164fab-f3e0-4dba-a763-c5a3611ddac0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:50.966156 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-28164fab-f3e0-4dba-a763-c5a3611ddac0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:50.966156 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-28164fab-f3e0-4dba-a763-c5a3611ddac0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:50.989682 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-6d22ceb7-8107-4972-af39-b70e5e0c2f32 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:50.990306 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-6d22ceb7-8107-4972-af39-b70e5e0c2f32 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:50.999903 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6d22ceb7-8107-4972-af39-b70e5e0c2f32 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:51.001407 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-28164fab-f3e0-4dba-a763-c5a3611ddac0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:51.001537 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6d22ceb7-8107-4972-af39-b70e5e0c2f32 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:51.001983 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-28164fab-f3e0-4dba-a763-c5a3611ddac0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:51.002104 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6d22ceb7-8107-4972-af39-b70e5e0c2f32 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:51.002415 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-28164fab-f3e0-4dba-a763-c5a3611ddac0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:51.002844 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6d22ceb7-8107-4972-af39-b70e5e0c2f32 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:51.002959 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-28164fab-f3e0-4dba-a763-c5a3611ddac0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lazy-loading 'fault' on Instance uuid eae5c9c4-de22-4f03-a66b-3b0a632131e0 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:55:51.003313 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6d22ceb7-8107-4972-af39-b70e5e0c2f32 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:51.003746 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6d22ceb7-8107-4972-af39-b70e5e0c2f32 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:51.046210 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-28164fab-f3e0-4dba-a763-c5a3611ddac0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:51.055162 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-28164fab-f3e0-4dba-a763-c5a3611ddac0 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1311 microversion: 2.1 time: 0.103955 Aug 26 15:55:51.055746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 361/715] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:50 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:51.079070 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-6d22ceb7-8107-4972-af39-b70e5e0c2f32 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:51.085670 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-6d22ceb7-8107-4972-af39-b70e5e0c2f32 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1224 microversion: 2.1 time: 0.102731 Aug 26 15:55:51.086247 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 355/716] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:50 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:51.489476 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-bce340a1-acf8-4cfe-a7dd-89a1af98ace8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:51.490208 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-bce340a1-acf8-4cfe-a7dd-89a1af98ace8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:51.497029 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bce340a1-acf8-4cfe-a7dd-89a1af98ace8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:51.497608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bce340a1-acf8-4cfe-a7dd-89a1af98ace8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:51.498014 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bce340a1-acf8-4cfe-a7dd-89a1af98ace8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:51.498706 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bce340a1-acf8-4cfe-a7dd-89a1af98ace8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:51.499147 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bce340a1-acf8-4cfe-a7dd-89a1af98ace8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:51.499557 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bce340a1-acf8-4cfe-a7dd-89a1af98ace8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:51.663383 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-bce340a1-acf8-4cfe-a7dd-89a1af98ace8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:51.671124 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-bce340a1-acf8-4cfe-a7dd-89a1af98ace8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1557 microversion: 2.1 time: 0.185933 Aug 26 15:55:51.671692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 362/717] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:51 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1557 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:51.692176 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-aca0e1e9-158b-4636-8c59-8bb4a8663448 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:51.696973 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-aca0e1e9-158b-4636-8c59-8bb4a8663448 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:51.699177 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aca0e1e9-158b-4636-8c59-8bb4a8663448 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:51.699659 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aca0e1e9-158b-4636-8c59-8bb4a8663448 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:51.700126 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aca0e1e9-158b-4636-8c59-8bb4a8663448 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:51.700821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aca0e1e9-158b-4636-8c59-8bb4a8663448 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:51.701302 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aca0e1e9-158b-4636-8c59-8bb4a8663448 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:51.701806 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aca0e1e9-158b-4636-8c59-8bb4a8663448 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:51.753664 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9ddf0017-0c3f-4926-829f-daa2e3e1d86c tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:51.754300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9ddf0017-0c3f-4926-829f-daa2e3e1d86c tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:51.760435 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9ddf0017-0c3f-4926-829f-daa2e3e1d86c tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:51.761030 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9ddf0017-0c3f-4926-829f-daa2e3e1d86c tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:51.761522 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9ddf0017-0c3f-4926-829f-daa2e3e1d86c tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:51.762219 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9ddf0017-0c3f-4926-829f-daa2e3e1d86c tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:51.762661 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9ddf0017-0c3f-4926-829f-daa2e3e1d86c tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:51.763105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9ddf0017-0c3f-4926-829f-daa2e3e1d86c tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:51.780637 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-aca0e1e9-158b-4636-8c59-8bb4a8663448 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092331 Aug 26 15:55:51.781867 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 356/718] 10.222.0.98 () {58 vars in 1275 bytes} [Fri Aug 26 15:55:51 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:55:51.929881 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9ddf0017-0c3f-4926-829f-daa2e3e1d86c tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:51.939056 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9ddf0017-0c3f-4926-829f-daa2e3e1d86c tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1756 microversion: 2.1 time: 0.189272 Aug 26 15:55:51.939770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 363/719] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:51 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:52.076549 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a06c3546-5fb2-49bd-8444-12e54b5b27bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:52.077193 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a06c3546-5fb2-49bd-8444-12e54b5b27bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:52.085459 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a06c3546-5fb2-49bd-8444-12e54b5b27bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:52.089652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a06c3546-5fb2-49bd-8444-12e54b5b27bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:52.089652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a06c3546-5fb2-49bd-8444-12e54b5b27bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:52.089652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a06c3546-5fb2-49bd-8444-12e54b5b27bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:52.089652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a06c3546-5fb2-49bd-8444-12e54b5b27bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:52.090070 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a06c3546-5fb2-49bd-8444-12e54b5b27bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:52.108560 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7bacef5c-551d-438b-9c04-f69f9f096dbd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:52.109280 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7bacef5c-551d-438b-9c04-f69f9f096dbd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:52.122087 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7bacef5c-551d-438b-9c04-f69f9f096dbd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:52.122699 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7bacef5c-551d-438b-9c04-f69f9f096dbd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:52.123461 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7bacef5c-551d-438b-9c04-f69f9f096dbd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:52.124292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7bacef5c-551d-438b-9c04-f69f9f096dbd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:52.124614 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a06c3546-5fb2-49bd-8444-12e54b5b27bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:52.125344 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7bacef5c-551d-438b-9c04-f69f9f096dbd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:52.125468 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a06c3546-5fb2-49bd-8444-12e54b5b27bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:52.125744 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a06c3546-5fb2-49bd-8444-12e54b5b27bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:52.125897 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7bacef5c-551d-438b-9c04-f69f9f096dbd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:52.126497 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-a06c3546-5fb2-49bd-8444-12e54b5b27bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lazy-loading 'fault' on Instance uuid eae5c9c4-de22-4f03-a66b-3b0a632131e0 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:55:52.161462 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7bacef5c-551d-438b-9c04-f69f9f096dbd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:52.162253 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7bacef5c-551d-438b-9c04-f69f9f096dbd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:52.162850 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7bacef5c-551d-438b-9c04-f69f9f096dbd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:52.163463 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-7bacef5c-551d-438b-9c04-f69f9f096dbd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lazy-loading 'fault' on Instance uuid 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:55:52.206985 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7bacef5c-551d-438b-9c04-f69f9f096dbd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:52.215879 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7bacef5c-551d-438b-9c04-f69f9f096dbd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1229 microversion: 2.1 time: 0.112227 Aug 26 15:55:52.216607 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 364/720] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:52 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1229 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:52.441789 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-a06c3546-5fb2-49bd-8444-12e54b5b27bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c01a893d3ab42cc97508768791ff38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853df33daae14bd9825788afd555e11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:52.449451 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-a06c3546-5fb2-49bd-8444-12e54b5b27bb tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 200 len: 1311 microversion: 2.1 time: 0.377208 Aug 26 15:55:52.450943 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 357/721] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:52 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 1311 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:52.961544 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-586bf2a8-ace6-413e-be9a-bb03c853db7b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:52.967724 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-586bf2a8-ace6-413e-be9a-bb03c853db7b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:52.968698 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-586bf2a8-ace6-413e-be9a-bb03c853db7b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:52.969192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-586bf2a8-ace6-413e-be9a-bb03c853db7b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:52.969629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-586bf2a8-ace6-413e-be9a-bb03c853db7b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:52.970332 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-586bf2a8-ace6-413e-be9a-bb03c853db7b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:52.970842 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-586bf2a8-ace6-413e-be9a-bb03c853db7b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:52.971269 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-586bf2a8-ace6-413e-be9a-bb03c853db7b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:53.119037 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-586bf2a8-ace6-413e-be9a-bb03c853db7b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:53.127396 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-586bf2a8-ace6-413e-be9a-bb03c853db7b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1759 microversion: 2.1 time: 0.169699 Aug 26 15:55:53.128002 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 365/722] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:52 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:53.185045 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-5d8f752a-15ae-49f5-a84c-b7feeecd241e req-f663f221-960c-402e-ab3c-1712fe8faf9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f30ecf-6ee4-4098-862e-3f5b5620b188", "tag": "bc49cf78-376c-4f7e-999a-0d25675122ef"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:53.195019 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-5d8f752a-15ae-49f5-a84c-b7feeecd241e req-f663f221-960c-402e-ab3c-1712fe8faf9b service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:53.195494 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-5d8f752a-15ae-49f5-a84c-b7feeecd241e req-f663f221-960c-402e-ab3c-1712fe8faf9b service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:53.196023 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-5d8f752a-15ae-49f5-a84c-b7feeecd241e req-f663f221-960c-402e-ab3c-1712fe8faf9b service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:53.208642 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-5d8f752a-15ae-49f5-a84c-b7feeecd241e req-f663f221-960c-402e-ab3c-1712fe8faf9b service nova] Creating event network-changed:bc49cf78-376c-4f7e-999a-0d25675122ef for instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 on hv-cinder-83124 Aug 26 15:55:53.213753 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-5d8f752a-15ae-49f5-a84c-b7feeecd241e req-f663f221-960c-402e-ab3c-1712fe8faf9b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032342 Aug 26 15:55:53.214463 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 358/723] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:53.238683 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-2d6736b4-a6db-4cc1-a53a-6947e4be73ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:53.238912 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-2d6736b4-a6db-4cc1-a53a-6947e4be73ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:53.241414 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:55:53.246076 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2d6736b4-a6db-4cc1-a53a-6947e4be73ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:53.246560 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2d6736b4-a6db-4cc1-a53a-6947e4be73ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:53.246991 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2d6736b4-a6db-4cc1-a53a-6947e4be73ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:53.247742 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2d6736b4-a6db-4cc1-a53a-6947e4be73ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:53.248213 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2d6736b4-a6db-4cc1-a53a-6947e4be73ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:53.248636 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2d6736b4-a6db-4cc1-a53a-6947e4be73ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:53.280141 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2d6736b4-a6db-4cc1-a53a-6947e4be73ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:53.280620 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2d6736b4-a6db-4cc1-a53a-6947e4be73ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:53.281054 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2d6736b4-a6db-4cc1-a53a-6947e4be73ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:53.281511 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-2d6736b4-a6db-4cc1-a53a-6947e4be73ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lazy-loading 'fault' on Instance uuid 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:55:53.328841 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2d6736b4-a6db-4cc1-a53a-6947e4be73ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:53.337333 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-2d6736b4-a6db-4cc1-a53a-6947e4be73ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 200 len: 1229 microversion: 2.1 time: 0.103082 Aug 26 15:55:53.338590 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 366/724] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:53 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:53.471624 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3ec140a5-f26d-4c76-bb4c-06345e8936f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:53.476891 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3ec140a5-f26d-4c76-bb4c-06345e8936f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] [instance: eae5c9c4-de22-4f03-a66b-3b0a632131e0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:53.479442 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ec140a5-f26d-4c76-bb4c-06345e8936f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:53.480161 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ec140a5-f26d-4c76-bb4c-06345e8936f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:53.480593 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ec140a5-f26d-4c76-bb4c-06345e8936f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:53.481548 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ec140a5-f26d-4c76-bb4c-06345e8936f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:53.482197 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ec140a5-f26d-4c76-bb4c-06345e8936f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:53.482622 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ec140a5-f26d-4c76-bb4c-06345e8936f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:53.498223 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-3ec140a5-f26d-4c76-bb4c-06345e8936f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] HTTP exception thrown: Instance eae5c9c4-de22-4f03-a66b-3b0a632131e0 could not be found. Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3ec140a5-f26d-4c76-bb4c-06345e8936f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Request method failure captured: Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 HTTP/1.1 Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOu4mB4haQKordFhuZBlwEB2sjzB1Ggq0RGqd_gZMlk7fOoxmsTjHxDr7EkB7u8NObi4d6APbLdClBiJmlJAqHVshko5l_rzaX5t4_54zFPQBeYab44MgJPCU1k-0j6OBkr3q7IvEClkDHMwJxZPzPX7sgNHTQ4qdi7FVVy-db3TXrw Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: 853df33daae14bd9825788afd555e11a Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1564618252 Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:55:53.500525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:55:53.502090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/853df33daae14bd9825788afd555e11a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_853df33daae14bd9825788afd555e11a", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/853df33daae14bd9825788afd555e11a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/853df33daae14bd9825788afd555e11a"}]}] Aug 26 15:55:53.502090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1564618252 Aug 26 15:55:53.502090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: 853df33daae14bd9825788afd555e11a Aug 26 15:55:53.502090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1564618252 Aug 26 15:55:53.502090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-ServerRescueNegativeTestJSON-1564618252-project Aug 26 15:55:53.502090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:55:53.502090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:55:53.502090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 5c01a893d3ab42cc97508768791ff38e Aug 26 15:55:53.502090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1564618252-project Aug 26 15:55:53.502090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:55:53.502090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance eae5c9c4-de22-4f03-a66b-3b0a632131e0 could not be found. Aug 26 15:55:53.502090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': 'eae5c9c4-de22-4f03-a66b-3b0a632131e0'} Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eae5c9c4-de22-4f03-a66b-3b0a632131e0 could not be found. Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:55:53.502841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eae5c9c4-de22-4f03-a66b-3b0a632131e0 could not be found. Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eae5c9c4-de22-4f03-a66b-3b0a632131e0 could not be found. Aug 26 15:55:53.504135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:55:53.507170 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3ec140a5-f26d-4c76-bb4c-06345e8936f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] Returning 404 to user: Instance eae5c9c4-de22-4f03-a66b-3b0a632131e0 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:55:53.508297 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3ec140a5-f26d-4c76-bb4c-06345e8936f3 tempest-ServerRescueNegativeTestJSON-1564618252 tempest-ServerRescueNegativeTestJSON-1564618252-project] 10.222.0.98 "GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0" status: 404 len: 111 microversion: 2.1 time: 0.040880 Aug 26 15:55:53.508953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 359/725] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:53 2022] GET /compute/v2.1/servers/eae5c9c4-de22-4f03-a66b-3b0a632131e0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:55:54.359037 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-cf93c016-1a8b-4b10-a832-aa6e661ece19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:54.359849 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-cf93c016-1a8b-4b10-a832-aa6e661ece19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:54.368145 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf93c016-1a8b-4b10-a832-aa6e661ece19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:54.374874 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf93c016-1a8b-4b10-a832-aa6e661ece19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:54.374874 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf93c016-1a8b-4b10-a832-aa6e661ece19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:54.374874 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf93c016-1a8b-4b10-a832-aa6e661ece19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:54.374874 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf93c016-1a8b-4b10-a832-aa6e661ece19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:54.375622 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf93c016-1a8b-4b10-a832-aa6e661ece19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:54.388660 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-cf93c016-1a8b-4b10-a832-aa6e661ece19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] HTTP exception thrown: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-cf93c016-1a8b-4b10-a832-aa6e661ece19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Request method failure captured: Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 HTTP/1.1 Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOw0gxYdmgd_KC6T2ZoJoPeBSQ6xSwQ51ggBKd5aVfnrjnSWk0JklefJXHG9ahlE4M8RPaAlFGIl7_7J8XrqPa-v1c1e98cyQQ7UrHyOzzdeRhvgBVmIPFFpTmfAzqqWpnI7-sH_xS4ckOyOXl6MQDH96OkFe0FDbRSPxZuiKT1_D0s Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: d19b01b0af6c43feb357799d8ae948e1 Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-TestVolumeBootPattern-107255747 Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:55:54.391200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:55:54.392746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d19b01b0af6c43feb357799d8ae948e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d19b01b0af6c43feb357799d8ae948e1", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d19b01b0af6c43feb357799d8ae948e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d19b01b0af6c43feb357799d8ae948e1"}]}] Aug 26 15:55:54.392746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-TestVolumeBootPattern-107255747 Aug 26 15:55:54.392746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: d19b01b0af6c43feb357799d8ae948e1 Aug 26 15:55:54.392746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-TestVolumeBootPattern-107255747 Aug 26 15:55:54.392746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-TestVolumeBootPattern-107255747-project Aug 26 15:55:54.392746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:55:54.392746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:55:54.392746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 436adf49f3e24e03971017ea6dd33ac8 Aug 26 15:55:54.392746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-TestVolumeBootPattern-107255747-project Aug 26 15:55:54.392746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:55:54.392746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. Aug 26 15:55:54.392746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '669aaa3a-3cdf-4764-aa7f-38e9cc9e9894'} Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:55:54.393588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. Aug 26 15:55:54.394896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:55:54.404532 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-cf93c016-1a8b-4b10-a832-aa6e661ece19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Returning 404 to user: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:55:54.404532 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-cf93c016-1a8b-4b10-a832-aa6e661ece19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 404 len: 111 microversion: 2.1 time: 0.037858 Aug 26 15:55:54.404532 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 367/726] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:54 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:55:54.500564 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-298498973", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-764795854", "security_groups": [{"name": "tempest-secgroup-smoke-605569295"}], "block_device_mapping_v2": [{"uuid": "d0280b9c-9115-471f-8fb3-4b068d1c9fe6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4908c59f-0bb1-43e0-b8ad-2ab3083c5d12"}]}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:54.642020 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.network.neutron [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] validate_networks() for [('4908c59f-0bb1-43e0-b8ad-2ab3083c5d12', None, None, None, None, None)] {{(pid=127698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:55:55.301866 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Flavor limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:55:55.302544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Image limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:55:55.303523 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Flavor pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:55:55.303523 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Image pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:55:55.304219 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:55:55.313515 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:55.328022 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:55.328022 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:55.328022 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:55.328022 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:55.328665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:55.336156 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Getting quotas for project d19b01b0af6c43feb357799d8ae948e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:55:55.340378 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Getting quotas for user 436adf49f3e24e03971017ea6dd33ac8 and project d19b01b0af6c43feb357799d8ae948e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:55:55.403033 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Going to run 1 instances... {{(pid=127698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:55:55.405285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d0280b9c-9115-471f-8fb3-4b068d1c9fe6',volume_size=None,volume_type=None)] {{(pid=127698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:55:55.720008 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b68c939f-34c6-44ff-bbe0-ab0d9b0e2d7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:55.721129 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b68c939f-34c6-44ff-bbe0-ab0d9b0e2d7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:55.727933 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b68c939f-34c6-44ff-bbe0-ab0d9b0e2d7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:55.728375 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b68c939f-34c6-44ff-bbe0-ab0d9b0e2d7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:55.728824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b68c939f-34c6-44ff-bbe0-ab0d9b0e2d7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:55.729512 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b68c939f-34c6-44ff-bbe0-ab0d9b0e2d7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:55.729962 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b68c939f-34c6-44ff-bbe0-ab0d9b0e2d7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:55.730386 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b68c939f-34c6-44ff-bbe0-ab0d9b0e2d7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:55.755075 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b68c939f-34c6-44ff-bbe0-ab0d9b0e2d7f tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/ips" status: 200 len: 146 microversion: 2.1 time: 0.118612 Aug 26 15:55:55.755631 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 368/727] 10.222.0.98 () {58 vars in 1248 bytes} [Fri Aug 26 15:55:55 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/ips => generated 146 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:55.958506 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c786bb7d-07ba-47f7-b28b-d442ffeb8e4b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.461916 Aug 26 15:55:55.968519 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 360/728] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:55:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:55:55.971744 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-136bebf3-4bcf-4dd3-a8d1-f4f8c7d45915 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:55.972675 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-136bebf3-4bcf-4dd3-a8d1-f4f8c7d45915 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:56.054639 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-136bebf3-4bcf-4dd3-a8d1-f4f8c7d45915 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:56.061907 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-136bebf3-4bcf-4dd3-a8d1-f4f8c7d45915 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1093 microversion: 2.1 time: 0.094963 Aug 26 15:55:56.067956 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 369/729] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:55 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1093 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:57.089444 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-098f5ea6-30ce-4782-b35d-4a1cd45d34b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:57.089444 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-098f5ea6-30ce-4782-b35d-4a1cd45d34b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:57.092536 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-098f5ea6-30ce-4782-b35d-4a1cd45d34b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:57.093060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-098f5ea6-30ce-4782-b35d-4a1cd45d34b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:57.093494 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-098f5ea6-30ce-4782-b35d-4a1cd45d34b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:57.094201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-098f5ea6-30ce-4782-b35d-4a1cd45d34b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:57.094643 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-098f5ea6-30ce-4782-b35d-4a1cd45d34b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:57.095061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-098f5ea6-30ce-4782-b35d-4a1cd45d34b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:57.165023 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-098f5ea6-30ce-4782-b35d-4a1cd45d34b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:57.168005 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-098f5ea6-30ce-4782-b35d-4a1cd45d34b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1143 microversion: 2.1 time: 0.088313 Aug 26 15:55:57.168576 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 361/730] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:57 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:55:57.685482 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-db93e922-dee9-451a-9ef7-ae94e900dea9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa64ea21-d724-4050-935b-e4903ed78c64"}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:55:57.687964 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-db93e922-dee9-451a-9ef7-ae94e900dea9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:57.710427 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-db93e922-dee9-451a-9ef7-ae94e900dea9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:57.711083 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-db93e922-dee9-451a-9ef7-ae94e900dea9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:57.711721 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-db93e922-dee9-451a-9ef7-ae94e900dea9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:57.713270 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-db93e922-dee9-451a-9ef7-ae94e900dea9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:57.713884 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-db93e922-dee9-451a-9ef7-ae94e900dea9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:57.714393 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-db93e922-dee9-451a-9ef7-ae94e900dea9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:58.189037 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4b054a8f-87ef-4188-9624-84b487ebe73e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:58.189652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-4b054a8f-87ef-4188-9624-84b487ebe73e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:58.196144 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b054a8f-87ef-4188-9624-84b487ebe73e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:58.196629 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b054a8f-87ef-4188-9624-84b487ebe73e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:58.197064 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b054a8f-87ef-4188-9624-84b487ebe73e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:58.197750 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b054a8f-87ef-4188-9624-84b487ebe73e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:58.198207 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b054a8f-87ef-4188-9624-84b487ebe73e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:58.198629 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4b054a8f-87ef-4188-9624-84b487ebe73e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:58.264820 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4b054a8f-87ef-4188-9624-84b487ebe73e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:58.273107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4b054a8f-87ef-4188-9624-84b487ebe73e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1191 microversion: 2.1 time: 0.087917 Aug 26 15:55:58.273681 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 362/731] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:58 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:55:58.607115 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-db93e922-dee9-451a-9ef7-ae94e900dea9 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "POST /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.925124 Aug 26 15:55:58.608675 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 370/732] 10.222.0.98 () {60 vars in 1323 bytes} [Fri Aug 26 15:55:57 2022] POST /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments => generated 194 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:55:59.295425 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d3bc335b-014d-451c-bc26-55a2ba7676ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:55:59.297058 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d3bc335b-014d-451c-bc26-55a2ba7676ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:55:59.305691 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d3bc335b-014d-451c-bc26-55a2ba7676ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:59.306312 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d3bc335b-014d-451c-bc26-55a2ba7676ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:59.306820 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d3bc335b-014d-451c-bc26-55a2ba7676ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:59.307616 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d3bc335b-014d-451c-bc26-55a2ba7676ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:59.308195 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d3bc335b-014d-451c-bc26-55a2ba7676ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:59.308689 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d3bc335b-014d-451c-bc26-55a2ba7676ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:59.385876 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d3bc335b-014d-451c-bc26-55a2ba7676ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:55:59.395820 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d3bc335b-014d-451c-bc26-55a2ba7676ab tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1209 microversion: 2.1 time: 0.105050 Aug 26 15:55:59.396663 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 363/733] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:55:59 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1209 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:00.422764 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0ea36870-a0fc-4a72-a7fe-b198836cb840 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:00.423474 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0ea36870-a0fc-4a72-a7fe-b198836cb840 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:00.430805 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ea36870-a0fc-4a72-a7fe-b198836cb840 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:00.431303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ea36870-a0fc-4a72-a7fe-b198836cb840 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:00.432466 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ea36870-a0fc-4a72-a7fe-b198836cb840 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:00.432466 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ea36870-a0fc-4a72-a7fe-b198836cb840 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:00.432923 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ea36870-a0fc-4a72-a7fe-b198836cb840 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:00.433456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ea36870-a0fc-4a72-a7fe-b198836cb840 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:00.616420 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0ea36870-a0fc-4a72-a7fe-b198836cb840 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:00.624955 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0ea36870-a0fc-4a72-a7fe-b198836cb840 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1276 microversion: 2.1 time: 0.206494 Aug 26 15:56:00.625535 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 371/734] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:00 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1276 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:01.203685 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-0aa423a6-4904-466e-a95e-3b1c3b7d470b req-6925810f-3ce0-4a88-bb4c-b96e588b5319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40898498-b30e-4c04-bef4-fca5f87da4c0", "tag": "9143864b-8fdf-40b9-bf7b-dddb7bfa986e"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:01.214885 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-0aa423a6-4904-466e-a95e-3b1c3b7d470b req-6925810f-3ce0-4a88-bb4c-b96e588b5319 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:01.215363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-0aa423a6-4904-466e-a95e-3b1c3b7d470b req-6925810f-3ce0-4a88-bb4c-b96e588b5319 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:01.216156 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-0aa423a6-4904-466e-a95e-3b1c3b7d470b req-6925810f-3ce0-4a88-bb4c-b96e588b5319 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:01.228922 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-0aa423a6-4904-466e-a95e-3b1c3b7d470b req-6925810f-3ce0-4a88-bb4c-b96e588b5319 service nova] Creating event network-changed:9143864b-8fdf-40b9-bf7b-dddb7bfa986e for instance 40898498-b30e-4c04-bef4-fca5f87da4c0 on hv-cinder-83124 Aug 26 15:56:01.235444 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-0aa423a6-4904-466e-a95e-3b1c3b7d470b req-6925810f-3ce0-4a88-bb4c-b96e588b5319 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035966 Aug 26 15:56:01.236254 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 364/735] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:01.648255 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-605e3f09-e164-4801-911b-bf96354c996b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:01.649356 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-605e3f09-e164-4801-911b-bf96354c996b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:01.659568 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-605e3f09-e164-4801-911b-bf96354c996b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:01.663453 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-605e3f09-e164-4801-911b-bf96354c996b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:01.663453 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-605e3f09-e164-4801-911b-bf96354c996b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:01.663453 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-605e3f09-e164-4801-911b-bf96354c996b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:01.663926 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-605e3f09-e164-4801-911b-bf96354c996b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:01.664749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-605e3f09-e164-4801-911b-bf96354c996b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:01.979423 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-605e3f09-e164-4801-911b-bf96354c996b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:01.997505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-605e3f09-e164-4801-911b-bf96354c996b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1276 microversion: 2.1 time: 0.353730 Aug 26 15:56:02.000435 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 372/736] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:01 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1276 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:03.021945 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-89fbc4d2-dfc6-4285-aad7-dfe84c8d3732 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:03.022766 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-89fbc4d2-dfc6-4285-aad7-dfe84c8d3732 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:03.029917 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89fbc4d2-dfc6-4285-aad7-dfe84c8d3732 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:03.030486 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89fbc4d2-dfc6-4285-aad7-dfe84c8d3732 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:03.030987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89fbc4d2-dfc6-4285-aad7-dfe84c8d3732 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:03.031914 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89fbc4d2-dfc6-4285-aad7-dfe84c8d3732 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:03.032367 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89fbc4d2-dfc6-4285-aad7-dfe84c8d3732 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:03.032788 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89fbc4d2-dfc6-4285-aad7-dfe84c8d3732 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:03.182001 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-89fbc4d2-dfc6-4285-aad7-dfe84c8d3732 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:03.190426 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-89fbc4d2-dfc6-4285-aad7-dfe84c8d3732 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1276 microversion: 2.1 time: 0.173174 Aug 26 15:56:03.191017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 365/737] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:03 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:04.210805 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-51062fcf-d06e-4dc6-b55c-2a83eefd40e9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:04.211471 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-51062fcf-d06e-4dc6-b55c-2a83eefd40e9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:04.217932 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-51062fcf-d06e-4dc6-b55c-2a83eefd40e9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:04.218414 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-51062fcf-d06e-4dc6-b55c-2a83eefd40e9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:04.218851 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-51062fcf-d06e-4dc6-b55c-2a83eefd40e9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:04.219584 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-51062fcf-d06e-4dc6-b55c-2a83eefd40e9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:04.220035 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-51062fcf-d06e-4dc6-b55c-2a83eefd40e9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:04.220463 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-51062fcf-d06e-4dc6-b55c-2a83eefd40e9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:04.487388 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-51062fcf-d06e-4dc6-b55c-2a83eefd40e9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:04.500966 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-51062fcf-d06e-4dc6-b55c-2a83eefd40e9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1276 microversion: 2.1 time: 0.294046 Aug 26 15:56:04.505861 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 373/738] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:04 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1276 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:05.523400 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c0ad3ea1-73f2-4929-a212-9f37e4b4c096 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:05.524108 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c0ad3ea1-73f2-4929-a212-9f37e4b4c096 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:05.533415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:05.533415 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=6 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:05.535348 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0ad3ea1-73f2-4929-a212-9f37e4b4c096 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:05.535966 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0ad3ea1-73f2-4929-a212-9f37e4b4c096 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:05.536642 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0ad3ea1-73f2-4929-a212-9f37e4b4c096 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:05.537366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0ad3ea1-73f2-4929-a212-9f37e4b4c096 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:05.538136 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0ad3ea1-73f2-4929-a212-9f37e4b4c096 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:05.538569 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0ad3ea1-73f2-4929-a212-9f37e4b4c096 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:05.706338 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c0ad3ea1-73f2-4929-a212-9f37e4b4c096 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:05.714418 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c0ad3ea1-73f2-4929-a212-9f37e4b4c096 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1276 microversion: 2.1 time: 0.196114 Aug 26 15:56:05.715005 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 366/739] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:05 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:06.409986 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:06.535307 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-bbdea7b3-5d8f-48b8-978c-27447a0ea79e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Action: 'create', calling method: .version_select at 0x7fbd1e164af0>, body: {"keypair": {"name": "tempest-keypair-920015561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbRvvzzp/R5Bnxbh05DJFL5XrrptwAq213wH6hBP/VSCsH7cqRCB0SS76flYHTOPizORQU3Pcsoan5GZChV1VybNzk/ZygbkWO4rjNxp7aUHuXut7K0RYpXY4OGOqUFOg=="}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:06.552433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-bbdea7b3-5d8f-48b8-978c-27447a0ea79e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Getting quotas for project 10b0a72955244448954be539f99435e9. Resources: {'key_pairs'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:56:06.556583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-bbdea7b3-5d8f-48b8-978c-27447a0ea79e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Getting quotas for user 91966686fa7f4c5bb326cdb1e2abc1d9 and project 10b0a72955244448954be539f99435e9. Resources: {'key_pairs'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:56:06.664222 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-bbdea7b3-5d8f-48b8-978c-27447a0ea79e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.259472 Aug 26 15:56:06.664828 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 374/740] 10.222.0.98 () {62 vars in 1200 bytes} [Fri Aug 26 15:56:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 261 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 26 15:56:06.734860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-73146505-cd0d-4e89-9979-3b63b54fe0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:06.735531 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-73146505-cd0d-4e89-9979-3b63b54fe0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:06.743431 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-73146505-cd0d-4e89-9979-3b63b54fe0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:06.743949 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-73146505-cd0d-4e89-9979-3b63b54fe0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:06.744381 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-73146505-cd0d-4e89-9979-3b63b54fe0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:06.745076 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-73146505-cd0d-4e89-9979-3b63b54fe0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:06.745522 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-73146505-cd0d-4e89-9979-3b63b54fe0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:06.745937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-73146505-cd0d-4e89-9979-3b63b54fe0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:06.889652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-73146505-cd0d-4e89-9979-3b63b54fe0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:06.897362 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-73146505-cd0d-4e89-9979-3b63b54fe0c9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1276 microversion: 2.1 time: 0.166597 Aug 26 15:56:06.897935 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 367/741] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:06 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:07.304611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d3111158-c6ec-49a6-8c9e-f12b64850b8c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:07.306810 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d3111158-c6ec-49a6-8c9e-f12b64850b8c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:07.313883 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d3111158-c6ec-49a6-8c9e-f12b64850b8c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:07.318317 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d3111158-c6ec-49a6-8c9e-f12b64850b8c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:07.318317 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d3111158-c6ec-49a6-8c9e-f12b64850b8c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:07.318317 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d3111158-c6ec-49a6-8c9e-f12b64850b8c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:07.318317 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d3111158-c6ec-49a6-8c9e-f12b64850b8c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:07.318717 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d3111158-c6ec-49a6-8c9e-f12b64850b8c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:07.349292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d3111158-c6ec-49a6-8c9e-f12b64850b8c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048110 Aug 26 15:56:07.356062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 375/742] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:56:07 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:07.360778 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f605aa83-511d-4068-847b-eb64cc2033a4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:07.361169 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f605aa83-511d-4068-847b-eb64cc2033a4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:07.369954 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f605aa83-511d-4068-847b-eb64cc2033a4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:07.371040 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f605aa83-511d-4068-847b-eb64cc2033a4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:07.371678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f605aa83-511d-4068-847b-eb64cc2033a4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:07.372430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f605aa83-511d-4068-847b-eb64cc2033a4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:07.372889 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f605aa83-511d-4068-847b-eb64cc2033a4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:07.373459 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f605aa83-511d-4068-847b-eb64cc2033a4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:07.377374 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=100 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:07.403520 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f605aa83-511d-4068-847b-eb64cc2033a4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments/aa64ea21-d724-4050-935b-e4903ed78c64" status: 200 len: 194 microversion: 2.1 time: 0.046912 Aug 26 15:56:07.404167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 368/743] 10.222.0.98 () {58 vars in 1413 bytes} [Fri Aug 26 15:56:07 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments/aa64ea21-d724-4050-935b-e4903ed78c64 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:07.917464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5e7b4af4-b79c-4ad2-a6b1-df38fff1978e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:07.918229 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5e7b4af4-b79c-4ad2-a6b1-df38fff1978e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:07.924779 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e7b4af4-b79c-4ad2-a6b1-df38fff1978e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:07.925261 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e7b4af4-b79c-4ad2-a6b1-df38fff1978e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:07.925889 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e7b4af4-b79c-4ad2-a6b1-df38fff1978e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:07.929493 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e7b4af4-b79c-4ad2-a6b1-df38fff1978e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:07.929493 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e7b4af4-b79c-4ad2-a6b1-df38fff1978e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:07.929493 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e7b4af4-b79c-4ad2-a6b1-df38fff1978e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:08.119089 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5e7b4af4-b79c-4ad2-a6b1-df38fff1978e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:08.128659 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5e7b4af4-b79c-4ad2-a6b1-df38fff1978e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1276 microversion: 2.1 time: 0.214852 Aug 26 15:56:08.129662 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 376/744] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:07 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:09.153861 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c6873571-79f9-4dfb-bc80-b5364044990e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:09.156643 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c6873571-79f9-4dfb-bc80-b5364044990e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:09.171293 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-edb2b027-4484-4f01-a692-683ba722a11a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b83987c-c3dc-4eb4-8535-4835d220d526"}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:09.175247 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-edb2b027-4484-4f01-a692-683ba722a11a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:09.179136 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6873571-79f9-4dfb-bc80-b5364044990e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:09.179819 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6873571-79f9-4dfb-bc80-b5364044990e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:09.180926 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6873571-79f9-4dfb-bc80-b5364044990e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:09.181135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6873571-79f9-4dfb-bc80-b5364044990e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:09.181563 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6873571-79f9-4dfb-bc80-b5364044990e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:09.182039 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c6873571-79f9-4dfb-bc80-b5364044990e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:09.184946 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-edb2b027-4484-4f01-a692-683ba722a11a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:09.185607 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-edb2b027-4484-4f01-a692-683ba722a11a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:09.187504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-edb2b027-4484-4f01-a692-683ba722a11a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:09.187504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-edb2b027-4484-4f01-a692-683ba722a11a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:09.187504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-edb2b027-4484-4f01-a692-683ba722a11a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:09.188223 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-edb2b027-4484-4f01-a692-683ba722a11a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:09.356119 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c6873571-79f9-4dfb-bc80-b5364044990e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:09.365620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c6873571-79f9-4dfb-bc80-b5364044990e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1264 microversion: 2.1 time: 0.218160 Aug 26 15:56:09.378685 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 369/745] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:09 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:09.378685 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1077254136", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c85cbb4-dd28-48c8-b45e-6f3238b9e6d1"}], "security_groups": [{"name": "tempest-securitygroup--700914597"}], "key_name": "tempest-keypair-920015561", "user_data": "}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:09.429309 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:09.492614 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.network.neutron [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] validate_networks() for [('4c85cbb4-dd28-48c8-b45e-6f3238b9e6d1', None, None, None, None, None)] {{(pid=127698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:56:09.951262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Flavor limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:56:09.956221 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Image limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:56:09.957081 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Flavor pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:56:09.957584 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Image pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:56:09.959217 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:56:09.973081 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:09.974155 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:09.974566 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:09.975299 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:09.975757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:09.976238 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:09.995854 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Getting quotas for project 10b0a72955244448954be539f99435e9. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:56:10.000289 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Getting quotas for user 91966686fa7f4c5bb326cdb1e2abc1d9 and project 10b0a72955244448954be539f99435e9. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:56:10.012579 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Going to run 1 instances... {{(pid=127698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:56:10.015003 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:56:10.126636 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-271d3679-2339-42ac-8851-ec8255eafa81 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.759103 Aug 26 15:56:10.127501 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 370/746] 10.222.0.98 () {62 vars in 1188 bytes} [Fri Aug 26 15:56:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 26 15:56:10.138727 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0ffa69e1-86fd-45a2-9280-1d6752dfd898 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:10.139733 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0ffa69e1-86fd-45a2-9280-1d6752dfd898 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:10.152146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-edb2b027-4484-4f01-a692-683ba722a11a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "POST /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.986190 Aug 26 15:56:10.153667 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 377/747] 10.222.0.98 () {60 vars in 1323 bytes} [Fri Aug 26 15:56:09 2022] POST /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments => generated 194 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:10.256065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0ffa69e1-86fd-45a2-9280-1d6752dfd898 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:10.269155 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0ffa69e1-86fd-45a2-9280-1d6752dfd898 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:10.273408 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0ffa69e1-86fd-45a2-9280-1d6752dfd898 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:10.274620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0ffa69e1-86fd-45a2-9280-1d6752dfd898 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1281 microversion: 2.20 time: 0.139846 Aug 26 15:56:10.275291 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 371/748] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:56:10 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1281 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:56:10.390215 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b9a7a694-b6cf-4f4c-b081-ed9db0f32003 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:10.391550 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b9a7a694-b6cf-4f4c-b081-ed9db0f32003 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:10.400787 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9a7a694-b6cf-4f4c-b081-ed9db0f32003 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:10.401287 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9a7a694-b6cf-4f4c-b081-ed9db0f32003 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:10.402322 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9a7a694-b6cf-4f4c-b081-ed9db0f32003 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:10.402488 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9a7a694-b6cf-4f4c-b081-ed9db0f32003 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:10.402929 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9a7a694-b6cf-4f4c-b081-ed9db0f32003 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:10.403359 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9a7a694-b6cf-4f4c-b081-ed9db0f32003 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:10.554186 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b9a7a694-b6cf-4f4c-b081-ed9db0f32003 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:10.562975 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b9a7a694-b6cf-4f4c-b081-ed9db0f32003 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1264 microversion: 2.1 time: 0.179303 Aug 26 15:56:10.563557 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 378/749] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:10 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:11.299198 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2ba28095-d394-4ee1-b6e3-1b32ad424cc0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:11.300512 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2ba28095-d394-4ee1-b6e3-1b32ad424cc0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:11.307772 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2ba28095-d394-4ee1-b6e3-1b32ad424cc0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:11.308290 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2ba28095-d394-4ee1-b6e3-1b32ad424cc0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:11.308725 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2ba28095-d394-4ee1-b6e3-1b32ad424cc0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:11.309450 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2ba28095-d394-4ee1-b6e3-1b32ad424cc0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:11.309904 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2ba28095-d394-4ee1-b6e3-1b32ad424cc0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:11.310332 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2ba28095-d394-4ee1-b6e3-1b32ad424cc0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:11.375329 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2ba28095-d394-4ee1-b6e3-1b32ad424cc0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:11.383907 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2ba28095-d394-4ee1-b6e3-1b32ad424cc0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:11.385391 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2ba28095-d394-4ee1-b6e3-1b32ad424cc0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:11.386526 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2ba28095-d394-4ee1-b6e3-1b32ad424cc0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1285 microversion: 2.20 time: 0.091521 Aug 26 15:56:11.388207 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 372/750] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:56:11 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:56:11.585781 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1135bc7c-f26e-4537-a257-070ffd7de412 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:11.586494 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1135bc7c-f26e-4537-a257-070ffd7de412 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:11.594735 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1135bc7c-f26e-4537-a257-070ffd7de412 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:11.594735 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1135bc7c-f26e-4537-a257-070ffd7de412 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:11.594735 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1135bc7c-f26e-4537-a257-070ffd7de412 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:11.595029 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1135bc7c-f26e-4537-a257-070ffd7de412 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:11.595445 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1135bc7c-f26e-4537-a257-070ffd7de412 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:11.595886 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1135bc7c-f26e-4537-a257-070ffd7de412 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:11.743682 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1135bc7c-f26e-4537-a257-070ffd7de412 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:11.753280 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1135bc7c-f26e-4537-a257-070ffd7de412 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1264 microversion: 2.1 time: 0.172326 Aug 26 15:56:11.753823 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 379/751] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:11 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:12.410903 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d0a3eef7-4142-4312-8383-39f70ec2abc8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:12.412001 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d0a3eef7-4142-4312-8383-39f70ec2abc8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:12.418775 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0a3eef7-4142-4312-8383-39f70ec2abc8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:12.419255 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0a3eef7-4142-4312-8383-39f70ec2abc8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:12.426482 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0a3eef7-4142-4312-8383-39f70ec2abc8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:12.426482 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0a3eef7-4142-4312-8383-39f70ec2abc8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:12.426482 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0a3eef7-4142-4312-8383-39f70ec2abc8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:12.426482 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0a3eef7-4142-4312-8383-39f70ec2abc8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:12.486480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d0a3eef7-4142-4312-8383-39f70ec2abc8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:12.496288 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d0a3eef7-4142-4312-8383-39f70ec2abc8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:12.502857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d0a3eef7-4142-4312-8383-39f70ec2abc8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:12.502857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d0a3eef7-4142-4312-8383-39f70ec2abc8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1333 microversion: 2.20 time: 0.092476 Aug 26 15:56:12.502857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 373/752] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:56:12 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:56:12.775515 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a826cb47-56c1-4e7b-a747-fefc10bf14b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:12.776419 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a826cb47-56c1-4e7b-a747-fefc10bf14b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:12.784729 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a826cb47-56c1-4e7b-a747-fefc10bf14b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:12.785319 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a826cb47-56c1-4e7b-a747-fefc10bf14b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:12.785832 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a826cb47-56c1-4e7b-a747-fefc10bf14b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:12.786668 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a826cb47-56c1-4e7b-a747-fefc10bf14b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:12.787169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a826cb47-56c1-4e7b-a747-fefc10bf14b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:12.787630 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a826cb47-56c1-4e7b-a747-fefc10bf14b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:13.061129 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a826cb47-56c1-4e7b-a747-fefc10bf14b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:13.071410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a826cb47-56c1-4e7b-a747-fefc10bf14b5 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1264 microversion: 2.1 time: 0.300802 Aug 26 15:56:13.072414 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 380/753] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:12 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1264 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:13.524966 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-51c3f3aa-a3a1-4f63-b7f5-876839202844 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:13.525768 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-51c3f3aa-a3a1-4f63-b7f5-876839202844 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:13.541120 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-51c3f3aa-a3a1-4f63-b7f5-876839202844 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:13.541997 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-51c3f3aa-a3a1-4f63-b7f5-876839202844 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:13.542794 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-51c3f3aa-a3a1-4f63-b7f5-876839202844 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:13.544105 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-51c3f3aa-a3a1-4f63-b7f5-876839202844 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:13.544932 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-51c3f3aa-a3a1-4f63-b7f5-876839202844 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:13.545689 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-51c3f3aa-a3a1-4f63-b7f5-876839202844 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:13.651577 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-51c3f3aa-a3a1-4f63-b7f5-876839202844 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:13.665914 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-51c3f3aa-a3a1-4f63-b7f5-876839202844 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:13.669281 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-51c3f3aa-a3a1-4f63-b7f5-876839202844 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:13.671583 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-51c3f3aa-a3a1-4f63-b7f5-876839202844 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1339 microversion: 2.20 time: 0.151884 Aug 26 15:56:13.672763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 374/754] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:56:13 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1339 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:56:14.101374 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-97f06caf-ef8d-4871-b91d-40a4dbe519ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:14.102623 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-97f06caf-ef8d-4871-b91d-40a4dbe519ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:14.115215 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-97f06caf-ef8d-4871-b91d-40a4dbe519ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:14.116198 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-97f06caf-ef8d-4871-b91d-40a4dbe519ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:14.116992 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-97f06caf-ef8d-4871-b91d-40a4dbe519ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:14.118283 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-97f06caf-ef8d-4871-b91d-40a4dbe519ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:14.119123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-97f06caf-ef8d-4871-b91d-40a4dbe519ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:14.119960 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-97f06caf-ef8d-4871-b91d-40a4dbe519ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:14.361845 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-97f06caf-ef8d-4871-b91d-40a4dbe519ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:14.371641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-97f06caf-ef8d-4871-b91d-40a4dbe519ea tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1264 microversion: 2.1 time: 0.277388 Aug 26 15:56:14.372365 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 381/755] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:14 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1264 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:14.703662 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8203d75c-4158-4da5-b742-f078e21a696b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:14.706836 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-8203d75c-4158-4da5-b742-f078e21a696b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:14.707094 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:14.712633 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8203d75c-4158-4da5-b742-f078e21a696b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:14.713112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8203d75c-4158-4da5-b742-f078e21a696b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:14.713543 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8203d75c-4158-4da5-b742-f078e21a696b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:14.714261 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8203d75c-4158-4da5-b742-f078e21a696b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:14.714804 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8203d75c-4158-4da5-b742-f078e21a696b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:14.715232 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8203d75c-4158-4da5-b742-f078e21a696b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:14.866691 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8203d75c-4158-4da5-b742-f078e21a696b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:14.875781 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8203d75c-4158-4da5-b742-f078e21a696b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:14.877288 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8203d75c-4158-4da5-b742-f078e21a696b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:14.878481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-8203d75c-4158-4da5-b742-f078e21a696b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1406 microversion: 2.20 time: 0.180036 Aug 26 15:56:14.879071 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 375/756] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:56:14 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:56:15.172121 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-317c6eae-5bbc-4f42-9d00-042b9daf6488 req-900c0649-2bb1-446a-8899-5911f7f5e35e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6825d4-cc4d-4688-9532-01a6cee66ea2", "tag": "57bf8f97-285e-4041-93e6-6c458f946244"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:15.193718 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-317c6eae-5bbc-4f42-9d00-042b9daf6488 req-900c0649-2bb1-446a-8899-5911f7f5e35e service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:15.194566 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-317c6eae-5bbc-4f42-9d00-042b9daf6488 req-900c0649-2bb1-446a-8899-5911f7f5e35e service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:15.195329 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-317c6eae-5bbc-4f42-9d00-042b9daf6488 req-900c0649-2bb1-446a-8899-5911f7f5e35e service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:15.218487 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-317c6eae-5bbc-4f42-9d00-042b9daf6488 req-900c0649-2bb1-446a-8899-5911f7f5e35e service nova] Creating event network-changed:57bf8f97-285e-4041-93e6-6c458f946244 for instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 on hv-cinder-83124 Aug 26 15:56:15.228460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-317c6eae-5bbc-4f42-9d00-042b9daf6488 req-900c0649-2bb1-446a-8899-5911f7f5e35e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065235 Aug 26 15:56:15.229760 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 382/757] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:15.408311 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c0381640-9e92-4770-a082-099870e9ed34 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:15.414805 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c0381640-9e92-4770-a082-099870e9ed34 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:15.420643 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0381640-9e92-4770-a082-099870e9ed34 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:15.421574 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0381640-9e92-4770-a082-099870e9ed34 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:15.422388 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0381640-9e92-4770-a082-099870e9ed34 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:15.423492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0381640-9e92-4770-a082-099870e9ed34 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:15.424337 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0381640-9e92-4770-a082-099870e9ed34 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:15.424961 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c0381640-9e92-4770-a082-099870e9ed34 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:15.637959 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c0381640-9e92-4770-a082-099870e9ed34 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:15.646940 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c0381640-9e92-4770-a082-099870e9ed34 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1264 microversion: 2.1 time: 0.253007 Aug 26 15:56:15.647952 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 376/758] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:15 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1264 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:15.902970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-cb17c76a-1030-4dab-80f7-3b42e23e60dc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:15.903766 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-cb17c76a-1030-4dab-80f7-3b42e23e60dc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:15.910557 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cb17c76a-1030-4dab-80f7-3b42e23e60dc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:15.911055 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cb17c76a-1030-4dab-80f7-3b42e23e60dc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:15.911528 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cb17c76a-1030-4dab-80f7-3b42e23e60dc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:15.912286 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cb17c76a-1030-4dab-80f7-3b42e23e60dc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:15.912745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cb17c76a-1030-4dab-80f7-3b42e23e60dc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:15.913202 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cb17c76a-1030-4dab-80f7-3b42e23e60dc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:16.134842 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cb17c76a-1030-4dab-80f7-3b42e23e60dc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:16.144300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cb17c76a-1030-4dab-80f7-3b42e23e60dc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:16.146234 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cb17c76a-1030-4dab-80f7-3b42e23e60dc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:16.147601 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-cb17c76a-1030-4dab-80f7-3b42e23e60dc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1406 microversion: 2.20 time: 0.249231 Aug 26 15:56:16.160900 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 383/759] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:56:15 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:56:16.671995 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-91e5653b-2c43-4a72-8acc-36a664b02e80 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:16.671995 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-91e5653b-2c43-4a72-8acc-36a664b02e80 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:16.680466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91e5653b-2c43-4a72-8acc-36a664b02e80 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:16.681027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91e5653b-2c43-4a72-8acc-36a664b02e80 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:16.681549 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91e5653b-2c43-4a72-8acc-36a664b02e80 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:16.682382 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91e5653b-2c43-4a72-8acc-36a664b02e80 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:16.683077 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91e5653b-2c43-4a72-8acc-36a664b02e80 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:16.683743 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-91e5653b-2c43-4a72-8acc-36a664b02e80 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:16.828233 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-91e5653b-2c43-4a72-8acc-36a664b02e80 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:16.837005 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-91e5653b-2c43-4a72-8acc-36a664b02e80 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1264 microversion: 2.1 time: 0.171041 Aug 26 15:56:16.837595 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 377/760] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:16 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:17.172054 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7430ef32-7ca2-4d29-a97d-78e9faa9cffc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:17.172874 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7430ef32-7ca2-4d29-a97d-78e9faa9cffc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:17.175452 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=4 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:17.180925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7430ef32-7ca2-4d29-a97d-78e9faa9cffc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:17.181421 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7430ef32-7ca2-4d29-a97d-78e9faa9cffc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:17.181861 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7430ef32-7ca2-4d29-a97d-78e9faa9cffc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:17.182581 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7430ef32-7ca2-4d29-a97d-78e9faa9cffc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:17.183383 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7430ef32-7ca2-4d29-a97d-78e9faa9cffc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:17.183826 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7430ef32-7ca2-4d29-a97d-78e9faa9cffc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:17.334624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7430ef32-7ca2-4d29-a97d-78e9faa9cffc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:17.345156 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7430ef32-7ca2-4d29-a97d-78e9faa9cffc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:17.346720 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7430ef32-7ca2-4d29-a97d-78e9faa9cffc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:17.352808 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7430ef32-7ca2-4d29-a97d-78e9faa9cffc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1406 microversion: 2.20 time: 0.184647 Aug 26 15:56:17.353381 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 384/761] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:56:17 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:56:17.455708 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-f16038d0-7903-4e54-9c75-c30a73cac6c5 req-53833687-97c8-4161-bfa1-8e2bcaf767c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40898498-b30e-4c04-bef4-fca5f87da4c0", "name": "network-vif-plugged", "status": "completed", "tag": "9143864b-8fdf-40b9-bf7b-dddb7bfa986e"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:17.465769 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-f16038d0-7903-4e54-9c75-c30a73cac6c5 req-53833687-97c8-4161-bfa1-8e2bcaf767c5 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:17.466240 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-f16038d0-7903-4e54-9c75-c30a73cac6c5 req-53833687-97c8-4161-bfa1-8e2bcaf767c5 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:17.466667 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-f16038d0-7903-4e54-9c75-c30a73cac6c5 req-53833687-97c8-4161-bfa1-8e2bcaf767c5 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:17.477545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-f16038d0-7903-4e54-9c75-c30a73cac6c5 req-53833687-97c8-4161-bfa1-8e2bcaf767c5 service nova] Creating event network-vif-plugged:9143864b-8fdf-40b9-bf7b-dddb7bfa986e for instance 40898498-b30e-4c04-bef4-fca5f87da4c0 on hv-cinder-83124 Aug 26 15:56:17.482522 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-f16038d0-7903-4e54-9c75-c30a73cac6c5 req-53833687-97c8-4161-bfa1-8e2bcaf767c5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093450 Aug 26 15:56:17.483128 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 378/762] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:17.866734 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-3d08da1a-500c-4da7-a235-374b70f4e0be tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:17.867367 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-3d08da1a-500c-4da7-a235-374b70f4e0be tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:17.873549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3d08da1a-500c-4da7-a235-374b70f4e0be tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:17.874032 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3d08da1a-500c-4da7-a235-374b70f4e0be tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:17.874469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3d08da1a-500c-4da7-a235-374b70f4e0be tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:17.875169 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3d08da1a-500c-4da7-a235-374b70f4e0be tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:17.875652 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3d08da1a-500c-4da7-a235-374b70f4e0be tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:17.876108 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3d08da1a-500c-4da7-a235-374b70f4e0be tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:18.014287 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-3d08da1a-500c-4da7-a235-374b70f4e0be tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:18.022608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-3d08da1a-500c-4da7-a235-374b70f4e0be tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1264 microversion: 2.1 time: 0.159668 Aug 26 15:56:18.023185 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 385/763] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:17 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:18.377449 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7a3b3465-5b2b-4a3b-9ee7-b3b59711068f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:18.378219 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7a3b3465-5b2b-4a3b-9ee7-b3b59711068f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:18.385381 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7a3b3465-5b2b-4a3b-9ee7-b3b59711068f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:18.389110 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7a3b3465-5b2b-4a3b-9ee7-b3b59711068f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:18.389110 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7a3b3465-5b2b-4a3b-9ee7-b3b59711068f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:18.389110 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7a3b3465-5b2b-4a3b-9ee7-b3b59711068f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:18.389110 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7a3b3465-5b2b-4a3b-9ee7-b3b59711068f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:18.389665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7a3b3465-5b2b-4a3b-9ee7-b3b59711068f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:18.524214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7a3b3465-5b2b-4a3b-9ee7-b3b59711068f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:18.532972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7a3b3465-5b2b-4a3b-9ee7-b3b59711068f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:18.534401 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7a3b3465-5b2b-4a3b-9ee7-b3b59711068f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:18.535525 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7a3b3465-5b2b-4a3b-9ee7-b3b59711068f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1406 microversion: 2.20 time: 0.163364 Aug 26 15:56:18.536117 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 379/764] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:56:18 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:56:19.043427 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-cedea0a8-77c5-4bcd-b65a-cd0c3d8b4abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:19.043427 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-cedea0a8-77c5-4bcd-b65a-cd0c3d8b4abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:19.050216 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cedea0a8-77c5-4bcd-b65a-cd0c3d8b4abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:19.051254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cedea0a8-77c5-4bcd-b65a-cd0c3d8b4abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:19.051254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cedea0a8-77c5-4bcd-b65a-cd0c3d8b4abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:19.052516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cedea0a8-77c5-4bcd-b65a-cd0c3d8b4abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:19.052988 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cedea0a8-77c5-4bcd-b65a-cd0c3d8b4abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:19.053416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cedea0a8-77c5-4bcd-b65a-cd0c3d8b4abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:19.243894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cedea0a8-77c5-4bcd-b65a-cd0c3d8b4abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:19.252525 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-cedea0a8-77c5-4bcd-b65a-cd0c3d8b4abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1264 microversion: 2.1 time: 0.213734 Aug 26 15:56:19.255914 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 386/765] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:19 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1264 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:19.562912 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-24af70cd-d2c6-4eaf-987e-cafad99998f9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:19.563613 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-24af70cd-d2c6-4eaf-987e-cafad99998f9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:19.570879 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-24af70cd-d2c6-4eaf-987e-cafad99998f9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:19.571370 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-24af70cd-d2c6-4eaf-987e-cafad99998f9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:19.571805 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-24af70cd-d2c6-4eaf-987e-cafad99998f9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:19.572549 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-24af70cd-d2c6-4eaf-987e-cafad99998f9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:19.573004 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-24af70cd-d2c6-4eaf-987e-cafad99998f9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:19.573462 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-24af70cd-d2c6-4eaf-987e-cafad99998f9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:19.724941 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-24af70cd-d2c6-4eaf-987e-cafad99998f9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:19.733426 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-24af70cd-d2c6-4eaf-987e-cafad99998f9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:19.734906 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-24af70cd-d2c6-4eaf-987e-cafad99998f9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:19.737027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-24af70cd-d2c6-4eaf-987e-cafad99998f9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1406 microversion: 2.20 time: 0.177972 Aug 26 15:56:19.737597 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 380/766] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:56:19 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:56:19.940609 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-ec3adfc8-0112-48e7-a057-ee51de973443 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:19.943801 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ec3adfc8-0112-48e7-a057-ee51de973443 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:19.949888 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ec3adfc8-0112-48e7-a057-ee51de973443 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:19.954016 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ec3adfc8-0112-48e7-a057-ee51de973443 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:19.954016 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ec3adfc8-0112-48e7-a057-ee51de973443 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:19.954016 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ec3adfc8-0112-48e7-a057-ee51de973443 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:19.954016 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ec3adfc8-0112-48e7-a057-ee51de973443 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:19.954628 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ec3adfc8-0112-48e7-a057-ee51de973443 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:19.989073 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-ec3adfc8-0112-48e7-a057-ee51de973443 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052313 Aug 26 15:56:19.990385 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 387/767] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:56:19 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:20.135698 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7bb2cc91-f46a-4a62-b7e8-93c79abfc203 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:20.136137 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7bb2cc91-f46a-4a62-b7e8-93c79abfc203 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:20.138141 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:20.143179 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7bb2cc91-f46a-4a62-b7e8-93c79abfc203 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:20.143804 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7bb2cc91-f46a-4a62-b7e8-93c79abfc203 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:20.144390 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7bb2cc91-f46a-4a62-b7e8-93c79abfc203 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:20.145105 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7bb2cc91-f46a-4a62-b7e8-93c79abfc203 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:20.145581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7bb2cc91-f46a-4a62-b7e8-93c79abfc203 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:20.146068 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7bb2cc91-f46a-4a62-b7e8-93c79abfc203 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:20.178623 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7bb2cc91-f46a-4a62-b7e8-93c79abfc203 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments/aa64ea21-d724-4050-935b-e4903ed78c64" status: 200 len: 194 microversion: 2.1 time: 0.047045 Aug 26 15:56:20.179233 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 381/768] 10.222.0.98 () {58 vars in 1413 bytes} [Fri Aug 26 15:56:20 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments/aa64ea21-d724-4050-935b-e4903ed78c64 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:20.193563 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-02ca49e2-4855-40ff-8763-2f78d78cc178 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:20.194312 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-02ca49e2-4855-40ff-8763-2f78d78cc178 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:20.201856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-02ca49e2-4855-40ff-8763-2f78d78cc178 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:20.202345 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-02ca49e2-4855-40ff-8763-2f78d78cc178 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:20.202779 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-02ca49e2-4855-40ff-8763-2f78d78cc178 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:20.203505 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-02ca49e2-4855-40ff-8763-2f78d78cc178 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:20.203995 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-02ca49e2-4855-40ff-8763-2f78d78cc178 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:20.204417 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-02ca49e2-4855-40ff-8763-2f78d78cc178 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:20.274494 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-37857c1e-37de-4dc5-8254-af034f6eb9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:20.275296 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-37857c1e-37de-4dc5-8254-af034f6eb9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:20.277305 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=8 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:20.282436 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-37857c1e-37de-4dc5-8254-af034f6eb9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:20.283029 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-37857c1e-37de-4dc5-8254-af034f6eb9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:20.283820 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-37857c1e-37de-4dc5-8254-af034f6eb9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:20.284577 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-37857c1e-37de-4dc5-8254-af034f6eb9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:20.285035 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-37857c1e-37de-4dc5-8254-af034f6eb9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:20.285468 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-37857c1e-37de-4dc5-8254-af034f6eb9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:20.305281 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-02ca49e2-4855-40ff-8763-2f78d78cc178 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lazy-loading 'services' on Instance uuid e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:56:20.453529 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-37857c1e-37de-4dc5-8254-af034f6eb9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:20.462495 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-37857c1e-37de-4dc5-8254-af034f6eb9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1264 microversion: 2.1 time: 0.192038 Aug 26 15:56:20.463057 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 382/769] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:20 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:56:20.577867 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-02ca49e2-4855-40ff-8763-2f78d78cc178 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments/aa64ea21-d724-4050-935b-e4903ed78c64" status: 202 len: 0 microversion: 2.1 time: 0.391292 Aug 26 15:56:20.582001 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 388/770] 10.222.0.98 () {58 vars in 1416 bytes} [Fri Aug 26 15:56:20 2022] DELETE /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments/aa64ea21-d724-4050-935b-e4903ed78c64 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:56:20.759527 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3bab378c-4c2f-42ba-9418-fd289b7817c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:20.760174 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3bab378c-4c2f-42ba-9418-fd289b7817c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:20.767050 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3bab378c-4c2f-42ba-9418-fd289b7817c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:20.767537 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3bab378c-4c2f-42ba-9418-fd289b7817c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:20.768001 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3bab378c-4c2f-42ba-9418-fd289b7817c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:20.768706 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3bab378c-4c2f-42ba-9418-fd289b7817c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:20.769160 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3bab378c-4c2f-42ba-9418-fd289b7817c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:20.769586 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3bab378c-4c2f-42ba-9418-fd289b7817c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:20.918153 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3bab378c-4c2f-42ba-9418-fd289b7817c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:20.928536 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3bab378c-4c2f-42ba-9418-fd289b7817c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:20.930006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3bab378c-4c2f-42ba-9418-fd289b7817c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:20.931156 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3bab378c-4c2f-42ba-9418-fd289b7817c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1406 microversion: 2.20 time: 0.176252 Aug 26 15:56:20.931727 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 383/771] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:56:20 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:56:21.433753 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-3c27655a-e3b9-4517-a17f-689b1bb90d30 req-9d284db8-ecce-4759-87ed-d0aaf0eb9d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6825d4-cc4d-4688-9532-01a6cee66ea2", "name": "network-vif-plugged", "status": "completed", "tag": "57bf8f97-285e-4041-93e6-6c458f946244"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:21.447396 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-3c27655a-e3b9-4517-a17f-689b1bb90d30 req-9d284db8-ecce-4759-87ed-d0aaf0eb9d53 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:21.447924 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-3c27655a-e3b9-4517-a17f-689b1bb90d30 req-9d284db8-ecce-4759-87ed-d0aaf0eb9d53 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:21.448414 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-3c27655a-e3b9-4517-a17f-689b1bb90d30 req-9d284db8-ecce-4759-87ed-d0aaf0eb9d53 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:21.460132 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-3c27655a-e3b9-4517-a17f-689b1bb90d30 req-9d284db8-ecce-4759-87ed-d0aaf0eb9d53 service nova] Creating event network-vif-plugged:57bf8f97-285e-4041-93e6-6c458f946244 for instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 on hv-cinder-83124 Aug 26 15:56:21.465869 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-3c27655a-e3b9-4517-a17f-689b1bb90d30 req-9d284db8-ecce-4759-87ed-d0aaf0eb9d53 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036653 Aug 26 15:56:21.465869 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 389/772] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:56:21.483374 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b5099dba-4c24-43ec-9e34-db0f9add27b4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:21.484043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b5099dba-4c24-43ec-9e34-db0f9add27b4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:21.490725 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b5099dba-4c24-43ec-9e34-db0f9add27b4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:21.491641 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b5099dba-4c24-43ec-9e34-db0f9add27b4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:21.491786 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b5099dba-4c24-43ec-9e34-db0f9add27b4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:21.492471 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b5099dba-4c24-43ec-9e34-db0f9add27b4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:21.492919 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b5099dba-4c24-43ec-9e34-db0f9add27b4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:21.493334 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b5099dba-4c24-43ec-9e34-db0f9add27b4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:21.656860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-b5099dba-4c24-43ec-9e34-db0f9add27b4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:21.665545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-b5099dba-4c24-43ec-9e34-db0f9add27b4 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1450 microversion: 2.1 time: 0.186316 Aug 26 15:56:21.666192 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 384/773] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:21 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1450 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:21.686712 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-85267732-a97c-4741-9f68-e335e4e09bba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:21.687475 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-85267732-a97c-4741-9f68-e335e4e09bba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:21.694826 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-85267732-a97c-4741-9f68-e335e4e09bba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:21.695306 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-85267732-a97c-4741-9f68-e335e4e09bba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:21.695734 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-85267732-a97c-4741-9f68-e335e4e09bba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:21.696464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-85267732-a97c-4741-9f68-e335e4e09bba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:21.696911 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-85267732-a97c-4741-9f68-e335e4e09bba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:21.697330 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-85267732-a97c-4741-9f68-e335e4e09bba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:21.838197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-85267732-a97c-4741-9f68-e335e4e09bba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:21.846218 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-85267732-a97c-4741-9f68-e335e4e09bba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1450 microversion: 2.1 time: 0.163777 Aug 26 15:56:21.857808 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 390/774] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:21 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:21.955144 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-43c97c22-8c9f-49ea-8132-269007693b53 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:21.956091 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-43c97c22-8c9f-49ea-8132-269007693b53 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:21.963751 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-43c97c22-8c9f-49ea-8132-269007693b53 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:21.964355 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-43c97c22-8c9f-49ea-8132-269007693b53 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:21.968411 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-43c97c22-8c9f-49ea-8132-269007693b53 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:21.968411 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-43c97c22-8c9f-49ea-8132-269007693b53 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:21.968411 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-43c97c22-8c9f-49ea-8132-269007693b53 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:21.968411 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-43c97c22-8c9f-49ea-8132-269007693b53 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:22.170850 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-43c97c22-8c9f-49ea-8132-269007693b53 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:22.181265 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-43c97c22-8c9f-49ea-8132-269007693b53 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:22.182695 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-43c97c22-8c9f-49ea-8132-269007693b53 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:22.183812 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-43c97c22-8c9f-49ea-8132-269007693b53 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1406 microversion: 2.20 time: 0.233736 Aug 26 15:56:22.188999 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 385/775] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:56:21 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:56:22.791820 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-00ee921c-43b0-4a7a-84a2-c26cf4ffd975 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:22.792454 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-00ee921c-43b0-4a7a-84a2-c26cf4ffd975 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:22.798854 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-00ee921c-43b0-4a7a-84a2-c26cf4ffd975 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:22.799327 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-00ee921c-43b0-4a7a-84a2-c26cf4ffd975 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:22.799760 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-00ee921c-43b0-4a7a-84a2-c26cf4ffd975 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:22.800490 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-00ee921c-43b0-4a7a-84a2-c26cf4ffd975 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:22.800946 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-00ee921c-43b0-4a7a-84a2-c26cf4ffd975 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:22.801432 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-00ee921c-43b0-4a7a-84a2-c26cf4ffd975 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:22.857930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-00ee921c-43b0-4a7a-84a2-c26cf4ffd975 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments/4b83987c-c3dc-4eb4-8535-4835d220d526" status: 200 len: 194 microversion: 2.1 time: 0.069607 Aug 26 15:56:22.863905 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 391/776] 10.222.0.98 () {58 vars in 1413 bytes} [Fri Aug 26 15:56:22 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments/4b83987c-c3dc-4eb4-8535-4835d220d526 => generated 194 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:22.869626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-478319c7-f942-466e-ace9-d7ca533c0021 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:22.870207 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-478319c7-f942-466e-ace9-d7ca533c0021 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:22.876737 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-478319c7-f942-466e-ace9-d7ca533c0021 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:22.877302 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-478319c7-f942-466e-ace9-d7ca533c0021 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:22.877809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-478319c7-f942-466e-ace9-d7ca533c0021 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:22.878618 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-478319c7-f942-466e-ace9-d7ca533c0021 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:22.879144 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-478319c7-f942-466e-ace9-d7ca533c0021 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:22.879635 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-478319c7-f942-466e-ace9-d7ca533c0021 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:22.990676 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-478319c7-f942-466e-ace9-d7ca533c0021 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lazy-loading 'services' on Instance uuid e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:56:22.994203 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=100 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:23.199775 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-478319c7-f942-466e-ace9-d7ca533c0021 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments/4b83987c-c3dc-4eb4-8535-4835d220d526" status: 202 len: 0 microversion: 2.1 time: 0.334048 Aug 26 15:56:23.200983 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 386/777] 10.222.0.98 () {58 vars in 1416 bytes} [Fri Aug 26 15:56:22 2022] DELETE /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments/4b83987c-c3dc-4eb4-8535-4835d220d526 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:56:23.222280 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5a975c67-6a0a-4fd3-92fe-c39646939f37 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:23.222959 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5a975c67-6a0a-4fd3-92fe-c39646939f37 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:23.232996 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a975c67-6a0a-4fd3-92fe-c39646939f37 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:23.233543 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a975c67-6a0a-4fd3-92fe-c39646939f37 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:23.233986 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a975c67-6a0a-4fd3-92fe-c39646939f37 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:23.234757 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a975c67-6a0a-4fd3-92fe-c39646939f37 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:23.235164 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a975c67-6a0a-4fd3-92fe-c39646939f37 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:23.235782 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5a975c67-6a0a-4fd3-92fe-c39646939f37 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:23.622807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5a975c67-6a0a-4fd3-92fe-c39646939f37 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:23.633488 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5a975c67-6a0a-4fd3-92fe-c39646939f37 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:23.635172 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5a975c67-6a0a-4fd3-92fe-c39646939f37 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:23.636590 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5a975c67-6a0a-4fd3-92fe-c39646939f37 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1406 microversion: 2.20 time: 0.418939 Aug 26 15:56:23.637353 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 392/778] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:56:23 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1406 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:56:24.390516 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-c0030918-c88c-4b79-b2eb-2fb25dc0f7f2 req-bfb09eaa-a2d6-4278-a821-36630dc42d55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40898498-b30e-4c04-bef4-fca5f87da4c0", "tag": "9143864b-8fdf-40b9-bf7b-dddb7bfa986e"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:24.401181 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-c0030918-c88c-4b79-b2eb-2fb25dc0f7f2 req-bfb09eaa-a2d6-4278-a821-36630dc42d55 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:24.401713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-c0030918-c88c-4b79-b2eb-2fb25dc0f7f2 req-bfb09eaa-a2d6-4278-a821-36630dc42d55 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:24.402155 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-c0030918-c88c-4b79-b2eb-2fb25dc0f7f2 req-bfb09eaa-a2d6-4278-a821-36630dc42d55 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:24.420109 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-c0030918-c88c-4b79-b2eb-2fb25dc0f7f2 req-bfb09eaa-a2d6-4278-a821-36630dc42d55 service nova] Creating event network-changed:9143864b-8fdf-40b9-bf7b-dddb7bfa986e for instance 40898498-b30e-4c04-bef4-fca5f87da4c0 on hv-cinder-83124 Aug 26 15:56:24.429353 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-c0030918-c88c-4b79-b2eb-2fb25dc0f7f2 req-bfb09eaa-a2d6-4278-a821-36630dc42d55 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042883 Aug 26 15:56:24.430424 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 387/779] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:56:24.660836 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-698f6b7b-0262-4186-8cd1-eda0db8c8a6d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:24.662338 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-698f6b7b-0262-4186-8cd1-eda0db8c8a6d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:24.671333 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-698f6b7b-0262-4186-8cd1-eda0db8c8a6d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:24.672220 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-698f6b7b-0262-4186-8cd1-eda0db8c8a6d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:24.672740 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-698f6b7b-0262-4186-8cd1-eda0db8c8a6d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:24.673821 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-698f6b7b-0262-4186-8cd1-eda0db8c8a6d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:24.674287 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-698f6b7b-0262-4186-8cd1-eda0db8c8a6d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:24.674710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-698f6b7b-0262-4186-8cd1-eda0db8c8a6d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:24.926183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-698f6b7b-0262-4186-8cd1-eda0db8c8a6d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:24.938533 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-698f6b7b-0262-4186-8cd1-eda0db8c8a6d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:24.940012 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-698f6b7b-0262-4186-8cd1-eda0db8c8a6d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:24.942085 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-698f6b7b-0262-4186-8cd1-eda0db8c8a6d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1406 microversion: 2.20 time: 0.286337 Aug 26 15:56:24.943552 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 393/780] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:56:24 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:56:25.491850 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7ea5be60-6777-4bbf-ae1c-ffac3ccdeccf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:25.494418 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7ea5be60-6777-4bbf-ae1c-ffac3ccdeccf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:25.500830 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ea5be60-6777-4bbf-ae1c-ffac3ccdeccf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:25.501315 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ea5be60-6777-4bbf-ae1c-ffac3ccdeccf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:25.501746 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ea5be60-6777-4bbf-ae1c-ffac3ccdeccf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:25.502459 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ea5be60-6777-4bbf-ae1c-ffac3ccdeccf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:25.502907 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ea5be60-6777-4bbf-ae1c-ffac3ccdeccf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:25.503326 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7ea5be60-6777-4bbf-ae1c-ffac3ccdeccf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:25.541384 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7ea5be60-6777-4bbf-ae1c-ffac3ccdeccf tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055024 Aug 26 15:56:25.541960 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 388/781] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:56:25 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 15:56:25.685099 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-77e50ec7-c6a9-4cdc-ad5a-312030be6a1c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:25.687468 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-77e50ec7-c6a9-4cdc-ad5a-312030be6a1c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:25.696748 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-77e50ec7-c6a9-4cdc-ad5a-312030be6a1c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:25.698542 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-77e50ec7-c6a9-4cdc-ad5a-312030be6a1c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:25.698542 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-77e50ec7-c6a9-4cdc-ad5a-312030be6a1c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:25.699694 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-77e50ec7-c6a9-4cdc-ad5a-312030be6a1c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:25.700740 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-77e50ec7-c6a9-4cdc-ad5a-312030be6a1c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:25.701478 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-77e50ec7-c6a9-4cdc-ad5a-312030be6a1c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:25.707385 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:25.735397 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-77e50ec7-c6a9-4cdc-ad5a-312030be6a1c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054197 Aug 26 15:56:25.735987 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 394/782] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:56:25 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 15:56:25.798448 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b07df516-381e-4273-bf18-2781c0bf2160 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:25.798954 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b07df516-381e-4273-bf18-2781c0bf2160 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:25.805672 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b07df516-381e-4273-bf18-2781c0bf2160 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:25.806241 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b07df516-381e-4273-bf18-2781c0bf2160 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:25.806689 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b07df516-381e-4273-bf18-2781c0bf2160 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:25.807425 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b07df516-381e-4273-bf18-2781c0bf2160 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:25.807910 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b07df516-381e-4273-bf18-2781c0bf2160 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:25.808332 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b07df516-381e-4273-bf18-2781c0bf2160 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:25.834457 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b07df516-381e-4273-bf18-2781c0bf2160 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Going to try to terminate instance {{(pid=127698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:56:25.965782 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-799d0c61-aa94-4488-aa06-415fa3754b8a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:25.966390 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-799d0c61-aa94-4488-aa06-415fa3754b8a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:25.968573 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:25.973484 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-799d0c61-aa94-4488-aa06-415fa3754b8a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:25.974537 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-799d0c61-aa94-4488-aa06-415fa3754b8a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:25.974973 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-799d0c61-aa94-4488-aa06-415fa3754b8a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:25.975670 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-799d0c61-aa94-4488-aa06-415fa3754b8a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:25.976150 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-799d0c61-aa94-4488-aa06-415fa3754b8a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:25.976582 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-799d0c61-aa94-4488-aa06-415fa3754b8a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:26.125836 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-799d0c61-aa94-4488-aa06-415fa3754b8a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:26.134636 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-799d0c61-aa94-4488-aa06-415fa3754b8a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:26.136089 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-799d0c61-aa94-4488-aa06-415fa3754b8a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:26.137241 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-799d0c61-aa94-4488-aa06-415fa3754b8a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1599 microversion: 2.20 time: 0.175683 Aug 26 15:56:26.137793 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 395/783] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:56:25 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:56:26.158096 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-b07df516-381e-4273-bf18-2781c0bf2160 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 204 len: 0 microversion: 2.1 time: 0.363449 Aug 26 15:56:26.159021 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 389/784] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:56:25 2022] DELETE /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:56:26.162416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-785dc96c-645f-4a53-9d00-7aa37ea4dda1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:26.162916 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-785dc96c-645f-4a53-9d00-7aa37ea4dda1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:26.169450 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8f9e8699-4cd1-4add-87ea-0d6441c05f88 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:26.169696 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-785dc96c-645f-4a53-9d00-7aa37ea4dda1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:26.170180 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-785dc96c-645f-4a53-9d00-7aa37ea4dda1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:26.170471 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-8f9e8699-4cd1-4add-87ea-0d6441c05f88 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:26.170620 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-785dc96c-645f-4a53-9d00-7aa37ea4dda1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:26.171319 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-785dc96c-645f-4a53-9d00-7aa37ea4dda1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:26.171782 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-785dc96c-645f-4a53-9d00-7aa37ea4dda1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:26.172217 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-785dc96c-645f-4a53-9d00-7aa37ea4dda1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:26.177884 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f9e8699-4cd1-4add-87ea-0d6441c05f88 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:26.178578 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f9e8699-4cd1-4add-87ea-0d6441c05f88 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:26.179155 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f9e8699-4cd1-4add-87ea-0d6441c05f88 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:26.180005 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f9e8699-4cd1-4add-87ea-0d6441c05f88 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:26.180553 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f9e8699-4cd1-4add-87ea-0d6441c05f88 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:26.181072 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8f9e8699-4cd1-4add-87ea-0d6441c05f88 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:26.267088 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-785dc96c-645f-4a53-9d00-7aa37ea4dda1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.111439 Aug 26 15:56:26.268099 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 396/785] 10.222.0.98 () {60 vars in 1316 bytes} [Fri Aug 26 15:56:26 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 15:56:26.338106 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8f9e8699-4cd1-4add-87ea-0d6441c05f88 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:26.347074 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-8f9e8699-4cd1-4add-87ea-0d6441c05f88 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1674 microversion: 2.1 time: 0.183127 Aug 26 15:56:26.347765 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 390/786] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:26 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:56:27.312247 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-d41d71e0-f77a-4c7b-92ff-9c234247180f req-29568451-d604-45db-98af-3f2b61e01379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6825d4-cc4d-4688-9532-01a6cee66ea2", "tag": "57bf8f97-285e-4041-93e6-6c458f946244"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:27.324059 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-d41d71e0-f77a-4c7b-92ff-9c234247180f req-29568451-d604-45db-98af-3f2b61e01379 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:27.324608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-d41d71e0-f77a-4c7b-92ff-9c234247180f req-29568451-d604-45db-98af-3f2b61e01379 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:27.325038 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-d41d71e0-f77a-4c7b-92ff-9c234247180f req-29568451-d604-45db-98af-3f2b61e01379 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:27.337224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-d41d71e0-f77a-4c7b-92ff-9c234247180f req-29568451-d604-45db-98af-3f2b61e01379 service nova] Creating event network-changed:57bf8f97-285e-4041-93e6-6c458f946244 for instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 on hv-cinder-83124 Aug 26 15:56:27.342538 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-d41d71e0-f77a-4c7b-92ff-9c234247180f req-29568451-d604-45db-98af-3f2b61e01379 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040469 Aug 26 15:56:27.343138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 397/787] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:56:27.370012 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d16da8ac-c39d-419b-b2c1-9529c0895672 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:27.374105 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d16da8ac-c39d-419b-b2c1-9529c0895672 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:27.377751 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d16da8ac-c39d-419b-b2c1-9529c0895672 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:27.378399 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d16da8ac-c39d-419b-b2c1-9529c0895672 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:27.378843 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d16da8ac-c39d-419b-b2c1-9529c0895672 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:27.379551 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d16da8ac-c39d-419b-b2c1-9529c0895672 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:27.380141 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d16da8ac-c39d-419b-b2c1-9529c0895672 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:27.381060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d16da8ac-c39d-419b-b2c1-9529c0895672 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:27.521730 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d16da8ac-c39d-419b-b2c1-9529c0895672 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:27.531427 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d16da8ac-c39d-419b-b2c1-9529c0895672 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1674 microversion: 2.1 time: 0.165373 Aug 26 15:56:27.532046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 391/788] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:27 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:28.557275 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-361390b0-70a8-4b3f-8da4-8da131b58ac3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:28.558604 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-361390b0-70a8-4b3f-8da4-8da131b58ac3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:28.569019 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-361390b0-70a8-4b3f-8da4-8da131b58ac3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:28.570147 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-361390b0-70a8-4b3f-8da4-8da131b58ac3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:28.570781 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-361390b0-70a8-4b3f-8da4-8da131b58ac3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:28.571747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-361390b0-70a8-4b3f-8da4-8da131b58ac3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:28.572382 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-361390b0-70a8-4b3f-8da4-8da131b58ac3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:28.573339 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-361390b0-70a8-4b3f-8da4-8da131b58ac3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:28.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-361390b0-70a8-4b3f-8da4-8da131b58ac3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:28.849317 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-361390b0-70a8-4b3f-8da4-8da131b58ac3 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1674 microversion: 2.1 time: 0.299214 Aug 26 15:56:28.850155 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 398/789] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:28 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1674 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:29.553607 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-3eb20140-dd41-4bb3-888f-8c3e1dd07967 req-b12e9ce8-43b6-4722-a1c9-42d80de23cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0a2d2ae-7ca7-4e36-8a70-14dc24125e00", "name": "network-vif-deleted", "tag": "9b82b23b-877d-4880-a87b-652c8b6c2ae6"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:29.564560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-3eb20140-dd41-4bb3-888f-8c3e1dd07967 req-b12e9ce8-43b6-4722-a1c9-42d80de23cee service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:29.565144 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-3eb20140-dd41-4bb3-888f-8c3e1dd07967 req-b12e9ce8-43b6-4722-a1c9-42d80de23cee service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:29.565586 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-3eb20140-dd41-4bb3-888f-8c3e1dd07967 req-b12e9ce8-43b6-4722-a1c9-42d80de23cee service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:29.579063 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-3eb20140-dd41-4bb3-888f-8c3e1dd07967 req-b12e9ce8-43b6-4722-a1c9-42d80de23cee service nova] Creating event network-vif-deleted:9b82b23b-877d-4880-a87b-652c8b6c2ae6 for instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 on hv-cinder-83124 Aug 26 15:56:29.586390 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-3eb20140-dd41-4bb3-888f-8c3e1dd07967 req-b12e9ce8-43b6-4722-a1c9-42d80de23cee service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038697 Aug 26 15:56:29.587243 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 392/790] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:29.883777 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b11b80f1-1503-487e-a811-992b7f8be40d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:29.884342 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b11b80f1-1503-487e-a811-992b7f8be40d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:29.891781 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b11b80f1-1503-487e-a811-992b7f8be40d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:29.892531 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b11b80f1-1503-487e-a811-992b7f8be40d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:29.892987 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b11b80f1-1503-487e-a811-992b7f8be40d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:29.893800 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b11b80f1-1503-487e-a811-992b7f8be40d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:29.894484 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b11b80f1-1503-487e-a811-992b7f8be40d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:29.894920 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b11b80f1-1503-487e-a811-992b7f8be40d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:29.931817 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b11b80f1-1503-487e-a811-992b7f8be40d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:29.932384 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b11b80f1-1503-487e-a811-992b7f8be40d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:29.933016 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b11b80f1-1503-487e-a811-992b7f8be40d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:29.933475 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-b11b80f1-1503-487e-a811-992b7f8be40d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lazy-loading 'fault' on Instance uuid e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:56:29.979852 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b11b80f1-1503-487e-a811-992b7f8be40d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861433b9f4441fe842b506def255c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc372e59524442debba38c57df458071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:29.988181 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b11b80f1-1503-487e-a811-992b7f8be40d tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 200 len: 1327 microversion: 2.1 time: 0.108977 Aug 26 15:56:29.988914 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 399/791] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:29 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:31.011597 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a62bdbc3-856f-4ac3-bdca-f2f13cfb7419 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:31.012363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a62bdbc3-856f-4ac3-bdca-f2f13cfb7419 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:31.020345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a62bdbc3-856f-4ac3-bdca-f2f13cfb7419 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:31.021019 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a62bdbc3-856f-4ac3-bdca-f2f13cfb7419 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:31.022155 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a62bdbc3-856f-4ac3-bdca-f2f13cfb7419 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:31.022974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a62bdbc3-856f-4ac3-bdca-f2f13cfb7419 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:31.023526 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a62bdbc3-856f-4ac3-bdca-f2f13cfb7419 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:31.024098 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a62bdbc3-856f-4ac3-bdca-f2f13cfb7419 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:31.040075 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-a62bdbc3-856f-4ac3-bdca-f2f13cfb7419 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] HTTP exception thrown: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a62bdbc3-856f-4ac3-bdca-f2f13cfb7419 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Request method failure captured: Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 HTTP/1.1 Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOuztnIGz-tC6orC6IJ_OI0N4kToQrIvAZwSeYvWRd_lulVdg6BvI_S4_6o_OoCs48o7yT3Om6ExAlW2QobVVAI6wZunYrhVluIk49mm7WCC2qgOIY7wIvXO_SMioyl5iatFC4WYexj6mh5L4tyUh_4_2KyytsRXOKulcn2fHGY3QOI Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: bc372e59524442debba38c57df458071 Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:56:31.041773 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:56:31.043363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/bc372e59524442debba38c57df458071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_bc372e59524442debba38c57df458071", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bc372e59524442debba38c57df458071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bc372e59524442debba38c57df458071"}]}] Aug 26 15:56:31.043363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:56:31.043363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: bc372e59524442debba38c57df458071 Aug 26 15:56:31.043363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:56:31.043363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-AttachVolumeTestJSON-786876667-project Aug 26 15:56:31.043363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:56:31.043363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:56:31.043363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 6861433b9f4441fe842b506def255c58 Aug 26 15:56:31.043363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-AttachVolumeTestJSON-786876667-project Aug 26 15:56:31.043363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:56:31.043363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. Aug 26 15:56:31.043363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': 'e0a2d2ae-7ca7-4e36-8a70-14dc24125e00'} Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:56:31.044214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. Aug 26 15:56:31.045610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:56:31.046991 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a62bdbc3-856f-4ac3-bdca-f2f13cfb7419 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Returning 404 to user: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:56:31.046991 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-a62bdbc3-856f-4ac3-bdca-f2f13cfb7419 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 404 len: 111 microversion: 2.1 time: 0.035906 Aug 26 15:56:31.046991 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 393/792] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:31 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:56:31.053529 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5500a5bf-c519-4002-8990-849c52af70fc tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '.version_select at 0x7fbd1e178ee0>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:31.143853 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5500a5bf-c519-4002-8990-849c52af70fc tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122624495" status: 202 len: 0 microversion: 2.1 time: 0.095313 Aug 26 15:56:31.144464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 400/793] 10.222.0.98 () {58 vars in 1221 bytes} [Fri Aug 26 15:56:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122624495 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:56:34.827363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5976a919-9bc1-40f6-a4ca-48f72dab94c4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:34.827958 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5976a919-9bc1-40f6-a4ca-48f72dab94c4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:34.835035 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5976a919-9bc1-40f6-a4ca-48f72dab94c4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:34.835521 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5976a919-9bc1-40f6-a4ca-48f72dab94c4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:34.836003 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5976a919-9bc1-40f6-a4ca-48f72dab94c4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:34.836710 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5976a919-9bc1-40f6-a4ca-48f72dab94c4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:34.837157 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5976a919-9bc1-40f6-a4ca-48f72dab94c4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:34.837575 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5976a919-9bc1-40f6-a4ca-48f72dab94c4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:34.851760 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-5976a919-9bc1-40f6-a4ca-48f72dab94c4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] HTTP exception thrown: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5976a919-9bc1-40f6-a4ca-48f72dab94c4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Request method failure captured: Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: DELETE /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 HTTP/1.1 Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOuztnIGz-tC6orC6IJ_OI0N4kToQrIvAZwSeYvWRd_lulVdg6BvI_S4_6o_OoCs48o7yT3Om6ExAlW2QobVVAI6wZunYrhVluIk49mm7WCC2qgOIY7wIvXO_SMioyl5iatFC4WYexj6mh5L4tyUh_4_2KyytsRXOKulcn2fHGY3QOI Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: bc372e59524442debba38c57df458071 Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:56:34.853320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:56:34.856480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/bc372e59524442debba38c57df458071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_bc372e59524442debba38c57df458071", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bc372e59524442debba38c57df458071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bc372e59524442debba38c57df458071"}]}] Aug 26 15:56:34.856480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:56:34.856480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: bc372e59524442debba38c57df458071 Aug 26 15:56:34.856480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:56:34.856480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-AttachVolumeTestJSON-786876667-project Aug 26 15:56:34.856480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:56:34.856480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:56:34.856480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 6861433b9f4441fe842b506def255c58 Aug 26 15:56:34.856480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-AttachVolumeTestJSON-786876667-project Aug 26 15:56:34.856480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:56:34.856480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. Aug 26 15:56:34.856480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': 'e0a2d2ae-7ca7-4e36-8a70-14dc24125e00'} Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:56:34.857386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. Aug 26 15:56:34.858717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:56:34.860371 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5976a919-9bc1-40f6-a4ca-48f72dab94c4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Returning 404 to user: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:56:34.860371 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5976a919-9bc1-40f6-a4ca-48f72dab94c4 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 404 len: 111 microversion: 2.1 time: 0.031526 Aug 26 15:56:34.860371 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 394/794] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:56:34 2022] DELETE /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:56:34.864669 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9d5a4df8-f5be-4c6a-b248-6a4a6c590f8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:34.865324 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9d5a4df8-f5be-4c6a-b248-6a4a6c590f8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: e0a2d2ae-7ca7-4e36-8a70-14dc24125e00] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:34.871303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9d5a4df8-f5be-4c6a-b248-6a4a6c590f8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:34.871787 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9d5a4df8-f5be-4c6a-b248-6a4a6c590f8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:34.872298 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9d5a4df8-f5be-4c6a-b248-6a4a6c590f8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:34.872962 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9d5a4df8-f5be-4c6a-b248-6a4a6c590f8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:34.873415 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9d5a4df8-f5be-4c6a-b248-6a4a6c590f8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:34.873841 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9d5a4df8-f5be-4c6a-b248-6a4a6c590f8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:34.889423 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-9d5a4df8-f5be-4c6a-b248-6a4a6c590f8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] HTTP exception thrown: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9d5a4df8-f5be-4c6a-b248-6a4a6c590f8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Request method failure captured: Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 HTTP/1.1 Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOuztnIGz-tC6orC6IJ_OI0N4kToQrIvAZwSeYvWRd_lulVdg6BvI_S4_6o_OoCs48o7yT3Om6ExAlW2QobVVAI6wZunYrhVluIk49mm7WCC2qgOIY7wIvXO_SMioyl5iatFC4WYexj6mh5L4tyUh_4_2KyytsRXOKulcn2fHGY3QOI Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: bc372e59524442debba38c57df458071 Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:56:34.891105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:56:34.892657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/bc372e59524442debba38c57df458071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_bc372e59524442debba38c57df458071", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bc372e59524442debba38c57df458071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bc372e59524442debba38c57df458071"}]}] Aug 26 15:56:34.892657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:56:34.892657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: bc372e59524442debba38c57df458071 Aug 26 15:56:34.892657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:56:34.892657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-AttachVolumeTestJSON-786876667-project Aug 26 15:56:34.892657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:56:34.892657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:56:34.892657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 6861433b9f4441fe842b506def255c58 Aug 26 15:56:34.892657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-AttachVolumeTestJSON-786876667-project Aug 26 15:56:34.892657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:56:34.892657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. Aug 26 15:56:34.892657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': 'e0a2d2ae-7ca7-4e36-8a70-14dc24125e00'} Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:56:34.893977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. Aug 26 15:56:34.897004 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:34.899075 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9d5a4df8-f5be-4c6a-b248-6a4a6c590f8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Returning 404 to user: Instance e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:56:34.899075 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9d5a4df8-f5be-4c6a-b248-6a4a6c590f8a tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00" status: 404 len: 111 microversion: 2.1 time: 0.032917 Aug 26 15:56:34.899075 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 401/795] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:34 2022] GET /compute/v2.1/servers/e0a2d2ae-7ca7-4e36-8a70-14dc24125e00 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:56:35.290904 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-9a76b68f-31d4-4ee2-85ad-0a571577a50b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-561218189"}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:35.291463 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-9a76b68f-31d4-4ee2-85ad-0a571577a50b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:35.298121 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a76b68f-31d4-4ee2-85ad-0a571577a50b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:35.298637 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a76b68f-31d4-4ee2-85ad-0a571577a50b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:35.299344 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a76b68f-31d4-4ee2-85ad-0a571577a50b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:35.300241 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a76b68f-31d4-4ee2-85ad-0a571577a50b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:35.300707 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a76b68f-31d4-4ee2-85ad-0a571577a50b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:35.301141 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a76b68f-31d4-4ee2-85ad-0a571577a50b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:35.444897 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.network.security_group_api [None req-9a76b68f-31d4-4ee2-85ad-0a571577a50b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Removing security group 0a2777e4-d9b3-4372-b251-565fb8eb4870 from port c3463a69-702b-4594-8fcf-701aaf1b3696 Aug 26 15:56:35.887741 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-9a76b68f-31d4-4ee2-85ad-0a571577a50b tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "POST /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/action" status: 202 len: 0 microversion: 2.1 time: 0.601511 Aug 26 15:56:35.891906 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 395/796] 10.222.0.98 () {60 vars in 1278 bytes} [Fri Aug 26 15:56:35 2022] POST /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:56:35.900082 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-7556506e-1c1c-441c-a56b-9037efdd95db req-93baf98e-051b-4ce3-aadc-295376813e57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe4d635-4211-49a0-99c5-aa69824b0de6", "tag": "c3463a69-702b-4594-8fcf-701aaf1b3696"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:35.929915 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-7556506e-1c1c-441c-a56b-9037efdd95db req-93baf98e-051b-4ce3-aadc-295376813e57 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:35.931182 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-7556506e-1c1c-441c-a56b-9037efdd95db req-93baf98e-051b-4ce3-aadc-295376813e57 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:35.931306 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-7556506e-1c1c-441c-a56b-9037efdd95db req-93baf98e-051b-4ce3-aadc-295376813e57 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:35.959378 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-7556506e-1c1c-441c-a56b-9037efdd95db req-93baf98e-051b-4ce3-aadc-295376813e57 service nova] Creating event network-changed:c3463a69-702b-4594-8fcf-701aaf1b3696 for instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 on hv-cinder-83124 Aug 26 15:56:35.965999 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-7556506e-1c1c-441c-a56b-9037efdd95db req-93baf98e-051b-4ce3-aadc-295376813e57 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068871 Aug 26 15:56:35.967828 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 402/797] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:36.317782 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ef46d007-2e91-41db-b585-57b8728fd34c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:36.320476 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ef46d007-2e91-41db-b585-57b8728fd34c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:36.332938 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ef46d007-2e91-41db-b585-57b8728fd34c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:36.334760 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ef46d007-2e91-41db-b585-57b8728fd34c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:36.335782 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ef46d007-2e91-41db-b585-57b8728fd34c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:36.337294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ef46d007-2e91-41db-b585-57b8728fd34c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:36.338318 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ef46d007-2e91-41db-b585-57b8728fd34c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:36.339331 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ef46d007-2e91-41db-b585-57b8728fd34c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:36.373670 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-ef46d007-2e91-41db-b585-57b8728fd34c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] HTTP exception thrown: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ef46d007-2e91-41db-b585-57b8728fd34c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Request method failure captured: Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: DELETE /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 HTTP/1.1 Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOuztnIGz-tC6orC6IJ_OI0N4kToQrIvAZwSeYvWRd_lulVdg6BvI_S4_6o_OoCs48o7yT3Om6ExAlW2QobVVAI6wZunYrhVluIk49mm7WCC2qgOIY7wIvXO_SMioyl5iatFC4WYexj6mh5L4tyUh_4_2KyytsRXOKulcn2fHGY3QOI Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: bc372e59524442debba38c57df458071 Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:56:36.377314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:56:36.380294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/bc372e59524442debba38c57df458071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_bc372e59524442debba38c57df458071", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bc372e59524442debba38c57df458071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bc372e59524442debba38c57df458071"}]}] Aug 26 15:56:36.380294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:56:36.380294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: bc372e59524442debba38c57df458071 Aug 26 15:56:36.380294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:56:36.380294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-AttachVolumeTestJSON-786876667-project Aug 26 15:56:36.380294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:56:36.380294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:56:36.380294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 6861433b9f4441fe842b506def255c58 Aug 26 15:56:36.380294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-AttachVolumeTestJSON-786876667-project Aug 26 15:56:36.380294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:56:36.380294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. Aug 26 15:56:36.380294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '6bdeefc3-4622-43da-a414-d7813721bc01'} Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:56:36.381908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. Aug 26 15:56:36.385167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:56:36.389241 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ef46d007-2e91-41db-b585-57b8728fd34c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Returning 404 to user: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:56:36.391048 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ef46d007-2e91-41db-b585-57b8728fd34c tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 404 len: 111 microversion: 2.1 time: 0.083335 Aug 26 15:56:36.392733 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 396/798] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:56:36 2022] DELETE /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 15:56:36.411107 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f367bf00-cc59-4d87-988f-7131df30e4b0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:36.414252 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f367bf00-cc59-4d87-988f-7131df30e4b0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] [instance: 6bdeefc3-4622-43da-a414-d7813721bc01] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:36.428015 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f367bf00-cc59-4d87-988f-7131df30e4b0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:36.428665 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f367bf00-cc59-4d87-988f-7131df30e4b0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:36.429208 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f367bf00-cc59-4d87-988f-7131df30e4b0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:36.430056 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f367bf00-cc59-4d87-988f-7131df30e4b0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:36.430666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f367bf00-cc59-4d87-988f-7131df30e4b0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:36.431237 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f367bf00-cc59-4d87-988f-7131df30e4b0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:36.447824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-f367bf00-cc59-4d87-988f-7131df30e4b0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] HTTP exception thrown: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f367bf00-cc59-4d87-988f-7131df30e4b0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Request method failure captured: Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 HTTP/1.1 Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOuztnIGz-tC6orC6IJ_OI0N4kToQrIvAZwSeYvWRd_lulVdg6BvI_S4_6o_OoCs48o7yT3Om6ExAlW2QobVVAI6wZunYrhVluIk49mm7WCC2qgOIY7wIvXO_SMioyl5iatFC4WYexj6mh5L4tyUh_4_2KyytsRXOKulcn2fHGY3QOI Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: bc372e59524442debba38c57df458071 Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:56:36.450611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:56:36.452770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/bc372e59524442debba38c57df458071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_bc372e59524442debba38c57df458071", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bc372e59524442debba38c57df458071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bc372e59524442debba38c57df458071"}]}] Aug 26 15:56:36.452770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:56:36.452770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: bc372e59524442debba38c57df458071 Aug 26 15:56:36.452770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-786876667 Aug 26 15:56:36.452770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-AttachVolumeTestJSON-786876667-project Aug 26 15:56:36.452770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:56:36.452770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:56:36.452770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 6861433b9f4441fe842b506def255c58 Aug 26 15:56:36.452770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-AttachVolumeTestJSON-786876667-project Aug 26 15:56:36.452770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:56:36.452770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. Aug 26 15:56:36.452770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '6bdeefc3-4622-43da-a414-d7813721bc01'} Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:56:36.453688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. Aug 26 15:56:36.455113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:36.456475 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f367bf00-cc59-4d87-988f-7131df30e4b0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] Returning 404 to user: Instance 6bdeefc3-4622-43da-a414-d7813721bc01 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:56:36.456475 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f367bf00-cc59-4d87-988f-7131df30e4b0 tempest-AttachVolumeTestJSON-786876667 tempest-AttachVolumeTestJSON-786876667-project] 10.222.0.98 "GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01" status: 404 len: 111 microversion: 2.1 time: 0.053829 Aug 26 15:56:36.459569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 403/799] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:36 2022] GET /compute/v2.1/servers/6bdeefc3-4622-43da-a414-d7813721bc01 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:56:36.713867 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7b0caad0-163b-48d8-afe5-dd5c350fccfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:36.714786 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7b0caad0-163b-48d8-afe5-dd5c350fccfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:36.722166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b0caad0-163b-48d8-afe5-dd5c350fccfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:36.723365 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b0caad0-163b-48d8-afe5-dd5c350fccfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:36.724860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b0caad0-163b-48d8-afe5-dd5c350fccfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:36.727766 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b0caad0-163b-48d8-afe5-dd5c350fccfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:36.727766 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b0caad0-163b-48d8-afe5-dd5c350fccfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:36.727766 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7b0caad0-163b-48d8-afe5-dd5c350fccfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:36.753851 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7b0caad0-163b-48d8-afe5-dd5c350fccfd tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/ips" status: 200 len: 150 microversion: 2.1 time: 0.048196 Aug 26 15:56:36.754431 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 397/800] 10.222.0.98 () {58 vars in 1248 bytes} [Fri Aug 26 15:56:36 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:38.100296 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6acf6cc4-fbfb-4424-9e27-cb1978dc6979 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:38.101792 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6acf6cc4-fbfb-4424-9e27-cb1978dc6979 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:38.106026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-20dfb1d8-d6bb-43c2-9337-2e7d7c351433 req-a33af14d-66b8-4aac-9fb6-ceb1de05c72a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe4d635-4211-49a0-99c5-aa69824b0de6", "tag": "c3463a69-702b-4594-8fcf-701aaf1b3696"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:38.109763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6acf6cc4-fbfb-4424-9e27-cb1978dc6979 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:38.110447 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6acf6cc4-fbfb-4424-9e27-cb1978dc6979 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:38.111075 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6acf6cc4-fbfb-4424-9e27-cb1978dc6979 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:38.112062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6acf6cc4-fbfb-4424-9e27-cb1978dc6979 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:38.112679 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6acf6cc4-fbfb-4424-9e27-cb1978dc6979 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:38.113264 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6acf6cc4-fbfb-4424-9e27-cb1978dc6979 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:38.121243 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-20dfb1d8-d6bb-43c2-9337-2e7d7c351433 req-a33af14d-66b8-4aac-9fb6-ceb1de05c72a service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:38.123318 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-20dfb1d8-d6bb-43c2-9337-2e7d7c351433 req-a33af14d-66b8-4aac-9fb6-ceb1de05c72a service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:38.123928 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-20dfb1d8-d6bb-43c2-9337-2e7d7c351433 req-a33af14d-66b8-4aac-9fb6-ceb1de05c72a service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:38.143261 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-20dfb1d8-d6bb-43c2-9337-2e7d7c351433 req-a33af14d-66b8-4aac-9fb6-ceb1de05c72a service nova] Creating event network-changed:c3463a69-702b-4594-8fcf-701aaf1b3696 for instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 on hv-cinder-83124 Aug 26 15:56:38.149795 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-20dfb1d8-d6bb-43c2-9337-2e7d7c351433 req-a33af14d-66b8-4aac-9fb6-ceb1de05c72a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048105 Aug 26 15:56:38.151753 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 398/801] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:56:38.219293 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-6acf6cc4-fbfb-4424-9e27-cb1978dc6979 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lazy-loading 'services' on Instance uuid 6fe4d635-4211-49a0-99c5-aa69824b0de6 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:56:38.500991 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6acf6cc4-fbfb-4424-9e27-cb1978dc6979 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/os-volume_attachments/31c0efc1-6009-4861-a602-bed16e38c004" status: 202 len: 0 microversion: 2.1 time: 0.404712 Aug 26 15:56:38.504846 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 404/802] 10.222.0.98 () {58 vars in 1416 bytes} [Fri Aug 26 15:56:38 2022] DELETE /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/os-volume_attachments/31c0efc1-6009-4861-a602-bed16e38c004 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:56:38.519409 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-aab809b6-a36d-4068-9d0f-cd934cbf7153 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:38.524125 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-aab809b6-a36d-4068-9d0f-cd934cbf7153 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:38.554924 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aab809b6-a36d-4068-9d0f-cd934cbf7153 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:38.558844 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aab809b6-a36d-4068-9d0f-cd934cbf7153 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:38.560326 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aab809b6-a36d-4068-9d0f-cd934cbf7153 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:38.562286 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aab809b6-a36d-4068-9d0f-cd934cbf7153 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:38.566240 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aab809b6-a36d-4068-9d0f-cd934cbf7153 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:38.574398 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-aab809b6-a36d-4068-9d0f-cd934cbf7153 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:38.638280 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-aab809b6-a36d-4068-9d0f-cd934cbf7153 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127292 Aug 26 15:56:38.639410 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 399/803] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:56:38 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:38.675551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-10760d66-1217-4c6b-9669-ee8517a4e2e7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7aeb0629-b25a-4ea1-8c7c-3ffe783477a1"}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:38.681188 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-10760d66-1217-4c6b-9669-ee8517a4e2e7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:38.705393 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-10760d66-1217-4c6b-9669-ee8517a4e2e7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:38.706489 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-10760d66-1217-4c6b-9669-ee8517a4e2e7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:38.707458 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-10760d66-1217-4c6b-9669-ee8517a4e2e7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:38.721091 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-10760d66-1217-4c6b-9669-ee8517a4e2e7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:38.722230 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-10760d66-1217-4c6b-9669-ee8517a4e2e7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:38.723381 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-10760d66-1217-4c6b-9669-ee8517a4e2e7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:39.666231 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c14da56a-9f2c-4261-90e2-c76245e7a21a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:39.676622 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c14da56a-9f2c-4261-90e2-c76245e7a21a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:39.707126 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c14da56a-9f2c-4261-90e2-c76245e7a21a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:39.708150 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c14da56a-9f2c-4261-90e2-c76245e7a21a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:39.709693 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c14da56a-9f2c-4261-90e2-c76245e7a21a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:39.710926 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c14da56a-9f2c-4261-90e2-c76245e7a21a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:39.711810 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c14da56a-9f2c-4261-90e2-c76245e7a21a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:39.713296 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c14da56a-9f2c-4261-90e2-c76245e7a21a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:39.765804 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c14da56a-9f2c-4261-90e2-c76245e7a21a tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111694 Aug 26 15:56:39.766798 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 400/804] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:56:39 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:40.326036 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-10760d66-1217-4c6b-9669-ee8517a4e2e7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "POST /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.660837 Aug 26 15:56:40.327476 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 405/805] 10.222.0.98 () {60 vars in 1323 bytes} [Fri Aug 26 15:56:38 2022] POST /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/os-volume_attachments => generated 194 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:40.780834 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2d462647-ad33-44f5-a6c4-3f9bf16b56ff tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:40.783059 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2d462647-ad33-44f5-a6c4-3f9bf16b56ff tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:40.790017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2d462647-ad33-44f5-a6c4-3f9bf16b56ff tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:40.790505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2d462647-ad33-44f5-a6c4-3f9bf16b56ff tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:40.790947 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2d462647-ad33-44f5-a6c4-3f9bf16b56ff tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:40.791660 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2d462647-ad33-44f5-a6c4-3f9bf16b56ff tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:40.792141 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2d462647-ad33-44f5-a6c4-3f9bf16b56ff tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:40.792720 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2d462647-ad33-44f5-a6c4-3f9bf16b56ff tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:40.830389 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2d462647-ad33-44f5-a6c4-3f9bf16b56ff tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052794 Aug 26 15:56:40.831363 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 401/806] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:56:40 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 15:56:40.843766 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d6485d58-eec8-478a-9e69-554c51320949 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:40.844555 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d6485d58-eec8-478a-9e69-554c51320949 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:40.850762 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6485d58-eec8-478a-9e69-554c51320949 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:40.851243 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6485d58-eec8-478a-9e69-554c51320949 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:40.851677 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6485d58-eec8-478a-9e69-554c51320949 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:40.852419 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6485d58-eec8-478a-9e69-554c51320949 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:40.852868 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6485d58-eec8-478a-9e69-554c51320949 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:40.853292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d6485d58-eec8-478a-9e69-554c51320949 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:40.935736 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-d6485d58-eec8-478a-9e69-554c51320949 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] HTTP exception thrown: Instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 is not attached to volume 31c0efc1-6009-4861-a602-bed16e38c004 Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d6485d58-eec8-478a-9e69-554c51320949 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Request method failure captured: Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: DELETE /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/os-volume_attachments/31c0efc1-6009-4861-a602-bed16e38c004 HTTP/1.1 Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOx_UqKyt8Mbleq3zcFwSdd3FW1CCzxcCkOfB7SPHbftT94PgKvFNPbXiKsFUKXXddaQqdyj6WdhGe2P9ZfXudrSnGNVQgc9YaOP_qixMb-SxTjgtDMHtom4poXcQ1arROM941x1weVRUpfTeFO9G6OqLHB95FFoOm3DF51gHJQmgT4 Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: 1b64a7d4a15a4d019f7bfc17a59889a5 Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-TestMinimumBasicScenario-1881062698 Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:56:40.941074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:56:40.943629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1b64a7d4a15a4d019f7bfc17a59889a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1b64a7d4a15a4d019f7bfc17a59889a5", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1b64a7d4a15a4d019f7bfc17a59889a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1b64a7d4a15a4d019f7bfc17a59889a5"}]}] Aug 26 15:56:40.943629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-TestMinimumBasicScenario-1881062698 Aug 26 15:56:40.943629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: 1b64a7d4a15a4d019f7bfc17a59889a5 Aug 26 15:56:40.943629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1881062698 Aug 26 15:56:40.943629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-TestMinimumBasicScenario-1881062698-project Aug 26 15:56:40.943629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:56:40.943629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:56:40.943629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: b0eb3bddc1bd4557a280ad21f9092093 Aug 26 15:56:40.943629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-TestMinimumBasicScenario-1881062698-project Aug 26 15:56:40.943629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:56:40.943629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 is not attached to volume 31c0efc1-6009-4861-a602-bed16e38c004 Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'server_id': '6fe4d635-4211-49a0-99c5-aa69824b0de6', 'id': '31c0efc1-6009-4861-a602-bed16e38c004'} Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 31c0efc1-6009-4861-a602-bed16e38c004. Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:56:40.945079 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:56:40.947350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:56:40.947350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 26 15:56:40.947350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 26 15:56:40.947350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 is not attached to volume 31c0efc1-6009-4861-a602-bed16e38c004 Aug 26 15:56:40.947350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:40.947350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:40.947350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:40.947350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:40.947350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:40.947350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:40.947350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:56:40.947350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:56:40.947350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 is not attached to volume 31c0efc1-6009-4861-a602-bed16e38c004 Aug 26 15:56:40.947350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:40.947350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d6485d58-eec8-478a-9e69-554c51320949 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Returning 404 to user: Instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 is not attached to volume 31c0efc1-6009-4861-a602-bed16e38c004 {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:56:40.949471 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d6485d58-eec8-478a-9e69-554c51320949 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/os-volume_attachments/31c0efc1-6009-4861-a602-bed16e38c004" status: 404 len: 154 microversion: 2.1 time: 0.100796 Aug 26 15:56:40.949471 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 406/807] 10.222.0.98 () {58 vars in 1416 bytes} [Fri Aug 26 15:56:40 2022] DELETE /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6/os-volume_attachments/31c0efc1-6009-4861-a602-bed16e38c004 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 15:56:42.212622 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8e7b5c86-f300-484b-be44-d35a776d4c74 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:42.213171 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-8e7b5c86-f300-484b-be44-d35a776d4c74 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:42.219634 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8e7b5c86-f300-484b-be44-d35a776d4c74 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:42.220142 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8e7b5c86-f300-484b-be44-d35a776d4c74 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:42.220580 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8e7b5c86-f300-484b-be44-d35a776d4c74 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:42.221327 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8e7b5c86-f300-484b-be44-d35a776d4c74 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:42.221775 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8e7b5c86-f300-484b-be44-d35a776d4c74 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:42.222189 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8e7b5c86-f300-484b-be44-d35a776d4c74 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:42.247307 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-8e7b5c86-f300-484b-be44-d35a776d4c74 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Going to try to terminate instance {{(pid=127698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:56:42.639018 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-8e7b5c86-f300-484b-be44-d35a776d4c74 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 204 len: 0 microversion: 2.1 time: 0.430727 Aug 26 15:56:42.639958 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 402/808] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:56:42 2022] DELETE /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:56:42.649499 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1365c8d2-d9a3-4f2c-86c4-73dcb1c8ab96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:42.650396 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1365c8d2-d9a3-4f2c-86c4-73dcb1c8ab96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:42.658478 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1365c8d2-d9a3-4f2c-86c4-73dcb1c8ab96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:42.659040 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1365c8d2-d9a3-4f2c-86c4-73dcb1c8ab96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:42.659551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1365c8d2-d9a3-4f2c-86c4-73dcb1c8ab96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:42.660481 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1365c8d2-d9a3-4f2c-86c4-73dcb1c8ab96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:42.661085 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1365c8d2-d9a3-4f2c-86c4-73dcb1c8ab96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:42.662085 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1365c8d2-d9a3-4f2c-86c4-73dcb1c8ab96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:42.798870 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1365c8d2-d9a3-4f2c-86c4-73dcb1c8ab96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:42.807255 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1365c8d2-d9a3-4f2c-86c4-73dcb1c8ab96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1554 microversion: 2.1 time: 0.162747 Aug 26 15:56:42.807803 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 407/809] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:42 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:43.830355 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-12887089-eb04-452a-bf25-b30cb1d08bc0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:43.830942 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-12887089-eb04-452a-bf25-b30cb1d08bc0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:43.837878 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-12887089-eb04-452a-bf25-b30cb1d08bc0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:43.841458 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-12887089-eb04-452a-bf25-b30cb1d08bc0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:43.841458 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-12887089-eb04-452a-bf25-b30cb1d08bc0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:43.841458 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-12887089-eb04-452a-bf25-b30cb1d08bc0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:43.841458 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-12887089-eb04-452a-bf25-b30cb1d08bc0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:43.842126 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-12887089-eb04-452a-bf25-b30cb1d08bc0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:43.992056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-12887089-eb04-452a-bf25-b30cb1d08bc0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:44.001360 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-12887089-eb04-452a-bf25-b30cb1d08bc0 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1554 microversion: 2.1 time: 0.175862 Aug 26 15:56:44.002308 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 403/810] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:43 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:56:45.023902 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5295fb04-9fea-4055-868c-541ae91eb350 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:45.024660 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5295fb04-9fea-4055-868c-541ae91eb350 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:45.032059 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5295fb04-9fea-4055-868c-541ae91eb350 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:45.032581 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5295fb04-9fea-4055-868c-541ae91eb350 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:45.033021 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5295fb04-9fea-4055-868c-541ae91eb350 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:45.033964 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5295fb04-9fea-4055-868c-541ae91eb350 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:45.034416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5295fb04-9fea-4055-868c-541ae91eb350 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:45.034842 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5295fb04-9fea-4055-868c-541ae91eb350 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:45.215724 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5295fb04-9fea-4055-868c-541ae91eb350 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:45.224986 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5295fb04-9fea-4055-868c-541ae91eb350 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1554 microversion: 2.1 time: 0.205057 Aug 26 15:56:45.225761 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 408/811] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:45 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1554 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:45.914957 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-6a200b9d-6945-42a2-8e80-08ac94c6c706 req-cbb0ca44-e783-457d-87aa-9d551e8528eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe4d635-4211-49a0-99c5-aa69824b0de6", "name": "network-vif-deleted", "tag": "c3463a69-702b-4594-8fcf-701aaf1b3696"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:45.924971 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-6a200b9d-6945-42a2-8e80-08ac94c6c706 req-cbb0ca44-e783-457d-87aa-9d551e8528eb service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:45.925443 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-6a200b9d-6945-42a2-8e80-08ac94c6c706 req-cbb0ca44-e783-457d-87aa-9d551e8528eb service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:45.925875 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-6a200b9d-6945-42a2-8e80-08ac94c6c706 req-cbb0ca44-e783-457d-87aa-9d551e8528eb service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:45.937118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-6a200b9d-6945-42a2-8e80-08ac94c6c706 req-cbb0ca44-e783-457d-87aa-9d551e8528eb service nova] Creating event network-vif-deleted:c3463a69-702b-4594-8fcf-701aaf1b3696 for instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 on hv-cinder-83124 Aug 26 15:56:45.941959 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-6a200b9d-6945-42a2-8e80-08ac94c6c706 req-cbb0ca44-e783-457d-87aa-9d551e8528eb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030794 Aug 26 15:56:45.942564 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 404/812] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:56:46.247070 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-fbfa7c38-17be-49c4-a669-6e1988131abd tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:46.247673 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-fbfa7c38-17be-49c4-a669-6e1988131abd tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:46.254461 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fbfa7c38-17be-49c4-a669-6e1988131abd tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:46.255013 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fbfa7c38-17be-49c4-a669-6e1988131abd tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:46.256040 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fbfa7c38-17be-49c4-a669-6e1988131abd tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:46.256934 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fbfa7c38-17be-49c4-a669-6e1988131abd tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:46.257391 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fbfa7c38-17be-49c4-a669-6e1988131abd tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:46.257816 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fbfa7c38-17be-49c4-a669-6e1988131abd tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:46.328236 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-fbfa7c38-17be-49c4-a669-6e1988131abd tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:46.337041 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-fbfa7c38-17be-49c4-a669-6e1988131abd tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1512 microversion: 2.1 time: 0.093807 Aug 26 15:56:46.337773 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 409/813] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:46 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1512 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:47.360874 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3ff7b000-0b8e-489f-ab83-9675797c3f96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:47.360874 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3ff7b000-0b8e-489f-ab83-9675797c3f96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:47.365375 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:47.375309 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ff7b000-0b8e-489f-ab83-9675797c3f96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:47.375804 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ff7b000-0b8e-489f-ab83-9675797c3f96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:47.376272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ff7b000-0b8e-489f-ab83-9675797c3f96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:47.376983 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ff7b000-0b8e-489f-ab83-9675797c3f96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:47.377446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ff7b000-0b8e-489f-ab83-9675797c3f96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:47.377883 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ff7b000-0b8e-489f-ab83-9675797c3f96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:47.383009 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:47.413526 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ff7b000-0b8e-489f-ab83-9675797c3f96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:47.414011 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ff7b000-0b8e-489f-ab83-9675797c3f96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:47.414444 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ff7b000-0b8e-489f-ab83-9675797c3f96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:47.414900 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-3ff7b000-0b8e-489f-ab83-9675797c3f96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lazy-loading 'fault' on Instance uuid 6fe4d635-4211-49a0-99c5-aa69824b0de6 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:56:47.464379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3ff7b000-0b8e-489f-ab83-9675797c3f96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb3bddc1bd4557a280ad21f9092093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64a7d4a15a4d019f7bfc17a59889a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:47.473592 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3ff7b000-0b8e-489f-ab83-9675797c3f96 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 200 len: 1348 microversion: 2.1 time: 0.118243 Aug 26 15:56:47.474482 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 405/814] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:47 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 1348 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:48.500375 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7691e47b-9c29-4201-8984-914459442c4f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:48.501562 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7691e47b-9c29-4201-8984-914459442c4f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] [instance: 6fe4d635-4211-49a0-99c5-aa69824b0de6] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:48.513212 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7691e47b-9c29-4201-8984-914459442c4f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:48.514023 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7691e47b-9c29-4201-8984-914459442c4f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:48.514775 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7691e47b-9c29-4201-8984-914459442c4f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:48.515988 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7691e47b-9c29-4201-8984-914459442c4f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:48.516753 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7691e47b-9c29-4201-8984-914459442c4f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:48.517456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7691e47b-9c29-4201-8984-914459442c4f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:48.543624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-7691e47b-9c29-4201-8984-914459442c4f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] HTTP exception thrown: Instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 could not be found. Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7691e47b-9c29-4201-8984-914459442c4f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Request method failure captured: Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 HTTP/1.1 Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOx_UqKyt8Mbleq3zcFwSdd3FW1CCzxcCkOfB7SPHbftT94PgKvFNPbXiKsFUKXXddaQqdyj6WdhGe2P9ZfXudrSnGNVQgc9YaOP_qixMb-SxTjgtDMHtom4poXcQ1arROM941x1weVRUpfTeFO9G6OqLHB95FFoOm3DF51gHJQmgT4 Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: 1b64a7d4a15a4d019f7bfc17a59889a5 Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-TestMinimumBasicScenario-1881062698 Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:56:48.546624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:56:48.549358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1b64a7d4a15a4d019f7bfc17a59889a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1b64a7d4a15a4d019f7bfc17a59889a5", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1b64a7d4a15a4d019f7bfc17a59889a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1b64a7d4a15a4d019f7bfc17a59889a5"}]}] Aug 26 15:56:48.549358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-TestMinimumBasicScenario-1881062698 Aug 26 15:56:48.549358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: 1b64a7d4a15a4d019f7bfc17a59889a5 Aug 26 15:56:48.549358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1881062698 Aug 26 15:56:48.549358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-TestMinimumBasicScenario-1881062698-project Aug 26 15:56:48.549358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:56:48.549358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:56:48.549358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: b0eb3bddc1bd4557a280ad21f9092093 Aug 26 15:56:48.549358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-TestMinimumBasicScenario-1881062698-project Aug 26 15:56:48.549358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:56:48.549358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 could not be found. Aug 26 15:56:48.549358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '6fe4d635-4211-49a0-99c5-aa69824b0de6'} Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 could not be found. Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:56:48.550925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 could not be found. Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 could not be found. Aug 26 15:56:48.555096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:48.557823 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7691e47b-9c29-4201-8984-914459442c4f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Returning 404 to user: Instance 6fe4d635-4211-49a0-99c5-aa69824b0de6 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:56:48.557823 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7691e47b-9c29-4201-8984-914459442c4f tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6" status: 404 len: 111 microversion: 2.1 time: 0.055729 Aug 26 15:56:48.557823 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 410/815] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:48 2022] GET /compute/v2.1/servers/6fe4d635-4211-49a0-99c5-aa69824b0de6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:56:48.561927 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-71b9aae4-61bb-4ed7-bfe2-9e1422b5d469 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] Calling method '.version_select at 0x7fbd1e22bca0>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:48.634279 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-71b9aae4-61bb-4ed7-bfe2-9e1422b5d469 tempest-TestMinimumBasicScenario-1881062698 tempest-TestMinimumBasicScenario-1881062698-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1995603639" status: 202 len: 0 microversion: 2.1 time: 0.077060 Aug 26 15:56:48.635020 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 406/816] 10.222.0.98 () {58 vars in 1272 bytes} [Fri Aug 26 15:56:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1995603639 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:56:49.074125 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-376990b3-1423-4474-8313-316fe098576a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7aeb0629-b25a-4ea1-8c7c-3ffe783477a1"}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:49.076879 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-376990b3-1423-4474-8313-316fe098576a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:49.083044 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-376990b3-1423-4474-8313-316fe098576a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:49.084097 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-376990b3-1423-4474-8313-316fe098576a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:49.084535 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-376990b3-1423-4474-8313-316fe098576a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:49.085246 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-376990b3-1423-4474-8313-316fe098576a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:49.085697 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-376990b3-1423-4474-8313-316fe098576a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:49.086120 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-376990b3-1423-4474-8313-316fe098576a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:49.177130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-376990b3-1423-4474-8313-316fe098576a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] HTTP exception thrown: Invalid volume: volume 7aeb0629-b25a-4ea1-8c7c-3ffe783477a1 is already attached to instances: 98f30ecf-6ee4-4098-862e-3f5b5620b188 Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-376990b3-1423-4474-8313-316fe098576a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Request method failure captured: Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: POST /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/os-volume_attachments HTTP/1.1 Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 74 Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOwce1DELhS8UmzpwnI-HX_EQrzE1_2dLaZIAb4DQQsaHzNq-4kKoCdv0aDJeKx2SvQqLHnYNV9XirCc5SAbojp-C1CHsa7OjA6o0rOrx5rLneplb_EX2pmB01iYBvFpO8o6110oFO2yAC5E6SvWdsfGmZrZ7TZSaR32s4VudVlpurQ Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:56:49.179062 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:56:49.191824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f40d6476c750438c9c09107c7757fa95", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}] Aug 26 15:56:49.191824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:56:49.191824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:56:49.191824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:56:49.191824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:56:49.191824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:56:49.191824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:56:49.191824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 9348310fd06b473786d1c6be4f20c481 Aug 26 15:56:49.191824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:56:49.191824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Aug 26 15:56:49.191824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {"volumeAttachment": {"volumeId": "7aeb0629-b25a-4ea1-8c7c-3ffe783477a1"}} Aug 26 15:56:49.191824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Invalid volume: volume 7aeb0629-b25a-4ea1-8c7c-3ffe783477a1 is already attached to instances: 98f30ecf-6ee4-4098-862e-3f5b5620b188 Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'server_id': '98f30ecf-6ee4-4098-862e-3f5b5620b188', 'body': {'volumeAttachment': {'volumeId': '7aeb0629-b25a-4ea1-8c7c-3ffe783477a1'}}} Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7aeb0629-b25a-4ea1-8c7c-3ffe783477a1 is already attached to instances: 98f30ecf-6ee4-4098-862e-3f5b5620b188 Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:49.194049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7aeb0629-b25a-4ea1-8c7c-3ffe783477a1 is already attached to instances: 98f30ecf-6ee4-4098-862e-3f5b5620b188 Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:49.196807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:49.200065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:49.200065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:56:49.200065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:56:49.200065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7aeb0629-b25a-4ea1-8c7c-3ffe783477a1 is already attached to instances: 98f30ecf-6ee4-4098-862e-3f5b5620b188 Aug 26 15:56:49.200065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:49.200065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-376990b3-1423-4474-8313-316fe098576a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Returning 400 to user: Invalid volume: volume 7aeb0629-b25a-4ea1-8c7c-3ffe783477a1 is already attached to instances: 98f30ecf-6ee4-4098-862e-3f5b5620b188 {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:56:49.200065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-376990b3-1423-4474-8313-316fe098576a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "POST /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110736 Aug 26 15:56:49.200065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 411/817] 10.222.0.98 () {60 vars in 1323 bytes} [Fri Aug 26 15:56:49 2022] POST /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 15:56:49.274662 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4763b99e-722a-4937-97a4-e8fcf831210b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:49.275161 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-4763b99e-722a-4937-97a4-e8fcf831210b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:49.281716 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4763b99e-722a-4937-97a4-e8fcf831210b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:49.288132 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4763b99e-722a-4937-97a4-e8fcf831210b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:49.288132 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4763b99e-722a-4937-97a4-e8fcf831210b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:49.288132 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4763b99e-722a-4937-97a4-e8fcf831210b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:49.288132 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4763b99e-722a-4937-97a4-e8fcf831210b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:49.288907 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4763b99e-722a-4937-97a4-e8fcf831210b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:49.384177 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-4763b99e-722a-4937-97a4-e8fcf831210b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lazy-loading 'services' on Instance uuid 98f30ecf-6ee4-4098-862e-3f5b5620b188 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:56:49.612137 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4763b99e-722a-4937-97a4-e8fcf831210b tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "DELETE /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/os-volume_attachments/7aeb0629-b25a-4ea1-8c7c-3ffe783477a1" status: 202 len: 0 microversion: 2.1 time: 0.341964 Aug 26 15:56:49.613017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 407/818] 10.222.0.98 () {58 vars in 1416 bytes} [Fri Aug 26 15:56:49 2022] DELETE /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/os-volume_attachments/7aeb0629-b25a-4ea1-8c7c-3ffe783477a1 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:56:49.623730 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f62601bf-0841-41fe-bf8e-7f17d070a381 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:49.626110 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f62601bf-0841-41fe-bf8e-7f17d070a381 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:49.633920 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f62601bf-0841-41fe-bf8e-7f17d070a381 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:49.639706 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f62601bf-0841-41fe-bf8e-7f17d070a381 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:49.639706 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f62601bf-0841-41fe-bf8e-7f17d070a381 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:49.639706 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f62601bf-0841-41fe-bf8e-7f17d070a381 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:49.639706 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f62601bf-0841-41fe-bf8e-7f17d070a381 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:49.640458 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f62601bf-0841-41fe-bf8e-7f17d070a381 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:49.669164 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f62601bf-0841-41fe-bf8e-7f17d070a381 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049536 Aug 26 15:56:49.670005 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 412/819] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:56:49 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:50.684317 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5967866a-f674-4469-a2e4-96df2e74e4a1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:50.687339 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5967866a-f674-4469-a2e4-96df2e74e4a1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:50.701069 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5967866a-f674-4469-a2e4-96df2e74e4a1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:50.702132 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5967866a-f674-4469-a2e4-96df2e74e4a1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:50.702925 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5967866a-f674-4469-a2e4-96df2e74e4a1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:50.704114 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5967866a-f674-4469-a2e4-96df2e74e4a1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:50.704893 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5967866a-f674-4469-a2e4-96df2e74e4a1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:50.705598 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5967866a-f674-4469-a2e4-96df2e74e4a1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:50.745902 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5967866a-f674-4469-a2e4-96df2e74e4a1 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066842 Aug 26 15:56:50.747006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 408/820] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:56:50 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:56:51.759219 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f4ef8741-73b4-4d98-8358-1e570b26e0f7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:51.761585 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f4ef8741-73b4-4d98-8358-1e570b26e0f7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:51.768990 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f4ef8741-73b4-4d98-8358-1e570b26e0f7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:51.769598 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f4ef8741-73b4-4d98-8358-1e570b26e0f7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:51.770086 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f4ef8741-73b4-4d98-8358-1e570b26e0f7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:51.770866 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f4ef8741-73b4-4d98-8358-1e570b26e0f7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:51.771392 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f4ef8741-73b4-4d98-8358-1e570b26e0f7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:51.771934 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f4ef8741-73b4-4d98-8358-1e570b26e0f7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:51.776335 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:51.806598 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f4ef8741-73b4-4d98-8358-1e570b26e0f7 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051505 Aug 26 15:56:51.807012 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 413/821] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:56:51 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 15:56:51.882157 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2ea661c2-5f4b-41fe-b686-4c362913995a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:51.883332 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2ea661c2-5f4b-41fe-b686-4c362913995a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:51.889933 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2ea661c2-5f4b-41fe-b686-4c362913995a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:51.890424 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2ea661c2-5f4b-41fe-b686-4c362913995a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:51.890859 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2ea661c2-5f4b-41fe-b686-4c362913995a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:51.891794 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2ea661c2-5f4b-41fe-b686-4c362913995a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:51.892294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2ea661c2-5f4b-41fe-b686-4c362913995a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:51.892714 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2ea661c2-5f4b-41fe-b686-4c362913995a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:51.920643 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2ea661c2-5f4b-41fe-b686-4c362913995a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Going to try to terminate instance {{(pid=127698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:56:52.218339 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2ea661c2-5f4b-41fe-b686-4c362913995a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "DELETE /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 204 len: 0 microversion: 2.1 time: 0.339666 Aug 26 15:56:52.219594 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 409/822] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:56:51 2022] DELETE /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:56:52.228297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-39090014-b5ba-4e4f-a306-48b5123f4027 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:52.229228 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-39090014-b5ba-4e4f-a306-48b5123f4027 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:52.236495 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-39090014-b5ba-4e4f-a306-48b5123f4027 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:52.237292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-39090014-b5ba-4e4f-a306-48b5123f4027 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:52.237996 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-39090014-b5ba-4e4f-a306-48b5123f4027 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:52.238925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-39090014-b5ba-4e4f-a306-48b5123f4027 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:52.239740 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-39090014-b5ba-4e4f-a306-48b5123f4027 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:52.240392 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-39090014-b5ba-4e4f-a306-48b5123f4027 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:52.416141 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-39090014-b5ba-4e4f-a306-48b5123f4027 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:52.425203 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-39090014-b5ba-4e4f-a306-48b5123f4027 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1682 microversion: 2.1 time: 0.201246 Aug 26 15:56:52.426579 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 414/823] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:52 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1682 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:53.450493 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ad49db47-2dae-4949-afc6-f34ae7af8bbf tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:53.451074 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ad49db47-2dae-4949-afc6-f34ae7af8bbf tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:53.458089 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ad49db47-2dae-4949-afc6-f34ae7af8bbf tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:53.458636 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ad49db47-2dae-4949-afc6-f34ae7af8bbf tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:53.459765 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ad49db47-2dae-4949-afc6-f34ae7af8bbf tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:53.460370 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ad49db47-2dae-4949-afc6-f34ae7af8bbf tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:53.460858 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ad49db47-2dae-4949-afc6-f34ae7af8bbf tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:53.461233 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ad49db47-2dae-4949-afc6-f34ae7af8bbf tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:53.707271 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ad49db47-2dae-4949-afc6-f34ae7af8bbf tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:53.720820 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ad49db47-2dae-4949-afc6-f34ae7af8bbf tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1682 microversion: 2.1 time: 0.274628 Aug 26 15:56:53.726272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 410/824] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:53 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1682 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:54.747365 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-59dfe58d-2e92-453f-a616-ad18b8ae1aba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:54.748968 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-59dfe58d-2e92-453f-a616-ad18b8ae1aba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:54.757425 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-59dfe58d-2e92-453f-a616-ad18b8ae1aba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:54.758077 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-59dfe58d-2e92-453f-a616-ad18b8ae1aba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:54.758649 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-59dfe58d-2e92-453f-a616-ad18b8ae1aba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:54.759413 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-59dfe58d-2e92-453f-a616-ad18b8ae1aba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:54.765681 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-59dfe58d-2e92-453f-a616-ad18b8ae1aba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:54.765681 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-59dfe58d-2e92-453f-a616-ad18b8ae1aba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:54.916566 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-59dfe58d-2e92-453f-a616-ad18b8ae1aba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:54.925097 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-59dfe58d-2e92-453f-a616-ad18b8ae1aba tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1682 microversion: 2.1 time: 0.182814 Aug 26 15:56:54.926682 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 415/825] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:54 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:55.696740 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-b037fa8a-2981-4bf6-b505-4e098731b719 req-bf7799d4-ffe0-49ac-98f0-de5f31e9cfb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f30ecf-6ee4-4098-862e-3f5b5620b188", "name": "network-vif-deleted", "tag": "bc49cf78-376c-4f7e-999a-0d25675122ef"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:55.714793 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-b037fa8a-2981-4bf6-b505-4e098731b719 req-bf7799d4-ffe0-49ac-98f0-de5f31e9cfb3 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:55.716008 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-b037fa8a-2981-4bf6-b505-4e098731b719 req-bf7799d4-ffe0-49ac-98f0-de5f31e9cfb3 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:55.716686 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-b037fa8a-2981-4bf6-b505-4e098731b719 req-bf7799d4-ffe0-49ac-98f0-de5f31e9cfb3 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:55.736226 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-b037fa8a-2981-4bf6-b505-4e098731b719 req-bf7799d4-ffe0-49ac-98f0-de5f31e9cfb3 service nova] Creating event network-vif-deleted:bc49cf78-376c-4f7e-999a-0d25675122ef for instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 on hv-cinder-83124 Aug 26 15:56:55.741920 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-b037fa8a-2981-4bf6-b505-4e098731b719 req-bf7799d4-ffe0-49ac-98f0-de5f31e9cfb3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049094 Aug 26 15:56:55.742850 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 411/826] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:55.947756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-dfc35476-56b7-4a59-b980-7406e5c53c05 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:55.948607 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-dfc35476-56b7-4a59-b980-7406e5c53c05 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:55.955405 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dfc35476-56b7-4a59-b980-7406e5c53c05 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:55.955927 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dfc35476-56b7-4a59-b980-7406e5c53c05 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:55.960436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dfc35476-56b7-4a59-b980-7406e5c53c05 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:55.960436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dfc35476-56b7-4a59-b980-7406e5c53c05 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:55.960436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dfc35476-56b7-4a59-b980-7406e5c53c05 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:55.960436 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dfc35476-56b7-4a59-b980-7406e5c53c05 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:56.022666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-dfc35476-56b7-4a59-b980-7406e5c53c05 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:56.030462 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-dfc35476-56b7-4a59-b980-7406e5c53c05 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1614 microversion: 2.1 time: 0.086592 Aug 26 15:56:56.031034 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 416/827] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:55 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1614 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:57.323568 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ff9ad5ba-2511-41f2-8e65-a9fe2236b51e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:57.324897 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ff9ad5ba-2511-41f2-8e65-a9fe2236b51e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:57.332194 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ff9ad5ba-2511-41f2-8e65-a9fe2236b51e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:57.332933 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ff9ad5ba-2511-41f2-8e65-a9fe2236b51e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:57.334146 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ff9ad5ba-2511-41f2-8e65-a9fe2236b51e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:57.335006 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ff9ad5ba-2511-41f2-8e65-a9fe2236b51e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:57.335452 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ff9ad5ba-2511-41f2-8e65-a9fe2236b51e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:57.336064 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ff9ad5ba-2511-41f2-8e65-a9fe2236b51e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:57.372144 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ff9ad5ba-2511-41f2-8e65-a9fe2236b51e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:57.372913 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ff9ad5ba-2511-41f2-8e65-a9fe2236b51e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:57.373497 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ff9ad5ba-2511-41f2-8e65-a9fe2236b51e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:57.374130 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-ff9ad5ba-2511-41f2-8e65-a9fe2236b51e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lazy-loading 'fault' on Instance uuid 98f30ecf-6ee4-4098-862e-3f5b5620b188 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:56:57.421977 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ff9ad5ba-2511-41f2-8e65-a9fe2236b51e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:57.430979 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ff9ad5ba-2511-41f2-8e65-a9fe2236b51e tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 200 len: 1331 microversion: 2.1 time: 0.381174 Aug 26 15:56:57.443900 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 412/828] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:57 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 1331 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:58.455147 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0c671106-3d5d-41a1-a143-c345ab7abdb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:58.455903 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0c671106-3d5d-41a1-a143-c345ab7abdb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:58.458368 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:58.464700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0c671106-3d5d-41a1-a143-c345ab7abdb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:58.465597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0c671106-3d5d-41a1-a143-c345ab7abdb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:58.466222 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0c671106-3d5d-41a1-a143-c345ab7abdb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:58.467182 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0c671106-3d5d-41a1-a143-c345ab7abdb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:58.467841 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0c671106-3d5d-41a1-a143-c345ab7abdb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:58.468440 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0c671106-3d5d-41a1-a143-c345ab7abdb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:58.483628 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-0c671106-3d5d-41a1-a143-c345ab7abdb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] HTTP exception thrown: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0c671106-3d5d-41a1-a143-c345ab7abdb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Request method failure captured: Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 HTTP/1.1 Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOwce1DELhS8UmzpwnI-HX_EQrzE1_2dLaZIAb4DQQsaHzNq-4kKoCdv0aDJeKx2SvQqLHnYNV9XirCc5SAbojp-C1CHsa7OjA6o0rOrx5rLneplb_EX2pmB01iYBvFpO8o6110oFO2yAC5E6SvWdsfGmZrZ7TZSaR32s4VudVlpurQ Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:56:58.485260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:56:58.486710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f40d6476c750438c9c09107c7757fa95", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}] Aug 26 15:56:58.486710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:56:58.486710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:56:58.486710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:56:58.486710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:56:58.486710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:56:58.486710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:56:58.486710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 9348310fd06b473786d1c6be4f20c481 Aug 26 15:56:58.486710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:56:58.486710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:56:58.486710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. Aug 26 15:56:58.486710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '98f30ecf-6ee4-4098-862e-3f5b5620b188'} Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:56:58.487597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. Aug 26 15:56:58.489224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:56:58.490368 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0c671106-3d5d-41a1-a143-c345ab7abdb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Returning 404 to user: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:56:58.490368 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0c671106-3d5d-41a1-a143-c345ab7abdb6 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 404 len: 111 microversion: 2.1 time: 0.036388 Aug 26 15:56:58.490368 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 417/829] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:58 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:56:58.497061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f5d3b1eb-07af-4578-b293-31c5f07fe25c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '.version_select at 0x7fbd1e08dc10>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:58.607795 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f5d3b1eb-07af-4578-b293-31c5f07fe25c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063969869" status: 202 len: 0 microversion: 2.1 time: 0.115668 Aug 26 15:56:58.608419 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 413/830] 10.222.0.98 () {58 vars in 1221 bytes} [Fri Aug 26 15:56:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063969869 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:56:59.683443 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-2c612126-b51c-4799-840b-e5ef1b7f0984 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Action: 'create', calling method: .version_select at 0x7fbd1e17b040>, body: {"keypair": {"name": "tempest-keypair-1796300171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsxf3Snk6o6mk4sGtrzqb92/mcdf99GNBJs5fVknf2Z/+qBQA5y274AvD058HhsSE7fgKyvaxHlFWDUJLljcIL1qHliC83f8BIIHnDjmh0g8A4D0SPqoWI5I0qvcPPcXw=="}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:59.716261 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-2c612126-b51c-4799-840b-e5ef1b7f0984 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for project f40d6476c750438c9c09107c7757fa95. Resources: {'key_pairs'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:56:59.731790 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-2c612126-b51c-4799-840b-e5ef1b7f0984 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for user 9348310fd06b473786d1c6be4f20c481 and project f40d6476c750438c9c09107c7757fa95. Resources: {'key_pairs'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:56:59.824883 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-2c612126-b51c-4799-840b-e5ef1b7f0984 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.145271 Aug 26 15:56:59.825584 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 418/831] 10.222.0.98 () {60 vars in 1159 bytes} [Fri Aug 26 15:56:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:02.902002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-154059107", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a335b766-ffd8-4d30-a4fc-6d81d957bfbd"}], "security_groups": [{"name": "tempest-securitygroup--1300290305"}], "key_name": "tempest-keypair-1796300171", "user_data": "}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:03.012235 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.network.neutron [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] validate_networks() for [('a335b766-ffd8-4d30-a4fc-6d81d957bfbd', None, None, None, None, None)] {{(pid=127698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:57:03.317045 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-bbd9f98e-1ccd-443c-9bea-cc02e3486595 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:03.317677 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-bbd9f98e-1ccd-443c-9bea-cc02e3486595 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:03.324973 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bbd9f98e-1ccd-443c-9bea-cc02e3486595 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:03.325467 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bbd9f98e-1ccd-443c-9bea-cc02e3486595 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:03.325906 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bbd9f98e-1ccd-443c-9bea-cc02e3486595 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:03.326624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bbd9f98e-1ccd-443c-9bea-cc02e3486595 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:03.327076 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bbd9f98e-1ccd-443c-9bea-cc02e3486595 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:03.327772 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bbd9f98e-1ccd-443c-9bea-cc02e3486595 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:03.354250 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-bbd9f98e-1ccd-443c-9bea-cc02e3486595 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/ips" status: 200 len: 153 microversion: 2.20 time: 0.041657 Aug 26 15:57:03.354836 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 419/832] 10.222.0.98 () {60 vars in 1289 bytes} [Fri Aug 26 15:57:03 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/ips => generated 153 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 15:57:03.432197 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Flavor limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:57:03.432624 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Image limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:57:03.433152 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Flavor pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:57:03.433563 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Image pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:57:03.433978 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:57:03.443895 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:03.444387 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:03.444809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:03.445540 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:03.445990 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:03.446419 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:03.464167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for project f40d6476c750438c9c09107c7757fa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:57:03.468224 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Getting quotas for user 9348310fd06b473786d1c6be4f20c481 and project f40d6476c750438c9c09107c7757fa95. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:57:03.480777 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Going to run 1 instances... {{(pid=127698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:57:03.483223 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:57:03.604838 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d50b8db5-1d3b-41dd-b75d-6ad1fb011a7c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.708011 Aug 26 15:57:03.608241 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 414/833] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:57:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:57:03.617626 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6027ee64-5c1b-4166-96d4-6d0a83eccf97 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:03.618321 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6027ee64-5c1b-4166-96d4-6d0a83eccf97 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:03.683446 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6027ee64-5c1b-4166-96d4-6d0a83eccf97 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:03.692966 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6027ee64-5c1b-4166-96d4-6d0a83eccf97 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1241 microversion: 2.1 time: 0.079702 Aug 26 15:57:03.694221 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 420/834] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:03 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:04.714945 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-eb657c53-120e-45bd-af28-bcd832e91b5c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:04.715698 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-eb657c53-120e-45bd-af28-bcd832e91b5c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:04.722639 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-eb657c53-120e-45bd-af28-bcd832e91b5c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:04.723574 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-eb657c53-120e-45bd-af28-bcd832e91b5c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:04.727700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-eb657c53-120e-45bd-af28-bcd832e91b5c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:04.737107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-eb657c53-120e-45bd-af28-bcd832e91b5c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:04.737107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-eb657c53-120e-45bd-af28-bcd832e91b5c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:04.737107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-eb657c53-120e-45bd-af28-bcd832e91b5c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:04.796667 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-eb657c53-120e-45bd-af28-bcd832e91b5c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:04.804671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-eb657c53-120e-45bd-af28-bcd832e91b5c tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1245 microversion: 2.1 time: 0.093832 Aug 26 15:57:04.805232 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 415/835] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:04 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:05.824527 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9addb777-301e-47c4-9e47-474397e702b5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:05.826472 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9addb777-301e-47c4-9e47-474397e702b5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:05.832133 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9addb777-301e-47c4-9e47-474397e702b5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:05.832623 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9addb777-301e-47c4-9e47-474397e702b5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:05.833074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9addb777-301e-47c4-9e47-474397e702b5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:05.834275 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9addb777-301e-47c4-9e47-474397e702b5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:05.834728 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9addb777-301e-47c4-9e47-474397e702b5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:05.835152 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9addb777-301e-47c4-9e47-474397e702b5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:05.897351 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9addb777-301e-47c4-9e47-474397e702b5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:05.905051 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9addb777-301e-47c4-9e47-474397e702b5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1293 microversion: 2.1 time: 0.084468 Aug 26 15:57:05.905613 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 421/836] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:05 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:06.389499 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1668f358-7c89-42d6-8ef6-f43c1092166e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:06.390264 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-1668f358-7c89-42d6-8ef6-f43c1092166e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:06.396966 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1668f358-7c89-42d6-8ef6-f43c1092166e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:06.397452 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1668f358-7c89-42d6-8ef6-f43c1092166e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:06.397880 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1668f358-7c89-42d6-8ef6-f43c1092166e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:06.398788 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1668f358-7c89-42d6-8ef6-f43c1092166e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:06.399239 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1668f358-7c89-42d6-8ef6-f43c1092166e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:06.399666 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1668f358-7c89-42d6-8ef6-f43c1092166e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:06.422729 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-1668f358-7c89-42d6-8ef6-f43c1092166e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lazy-loading 'flavor' on Instance uuid 9c6825d4-cc4d-4688-9532-01a6cee66ea2 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:57:06.926854 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-07f91057-4fd6-475d-b107-7e5694964d9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:06.928801 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-07f91057-4fd6-475d-b107-7e5694964d9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:06.936300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07f91057-4fd6-475d-b107-7e5694964d9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:06.936771 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07f91057-4fd6-475d-b107-7e5694964d9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:06.937389 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07f91057-4fd6-475d-b107-7e5694964d9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:06.938116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07f91057-4fd6-475d-b107-7e5694964d9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:06.938564 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07f91057-4fd6-475d-b107-7e5694964d9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:06.938979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-07f91057-4fd6-475d-b107-7e5694964d9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:07.001929 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-07f91057-4fd6-475d-b107-7e5694964d9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:07.010949 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-07f91057-4fd6-475d-b107-7e5694964d9a tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1311 microversion: 2.1 time: 0.088057 Aug 26 15:57:07.024295 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 422/837] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:06 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:07.065805 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-1668f358-7c89-42d6-8ef6-f43c1092166e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "POST /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/action" status: 202 len: 0 microversion: 2.20 time: 0.680505 Aug 26 15:57:07.066412 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 416/838] 10.222.0.98 () {62 vars in 1319 bytes} [Fri Aug 26 15:57:06 2022] POST /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:57:07.079173 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b07196a2-98a3-4991-8efd-665e814d0598 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:07.079173 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b07196a2-98a3-4991-8efd-665e814d0598 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:07.082792 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b07196a2-98a3-4991-8efd-665e814d0598 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:07.083477 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b07196a2-98a3-4991-8efd-665e814d0598 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:07.084008 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b07196a2-98a3-4991-8efd-665e814d0598 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:07.084760 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b07196a2-98a3-4991-8efd-665e814d0598 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:07.085302 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b07196a2-98a3-4991-8efd-665e814d0598 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:07.085803 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b07196a2-98a3-4991-8efd-665e814d0598 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:07.234687 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b07196a2-98a3-4991-8efd-665e814d0598 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:07.245305 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b07196a2-98a3-4991-8efd-665e814d0598 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:07.247130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b07196a2-98a3-4991-8efd-665e814d0598 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:07.248801 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b07196a2-98a3-4991-8efd-665e814d0598 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1724 microversion: 2.20 time: 0.177220 Aug 26 15:57:07.249449 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 423/839] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:07 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:08.033437 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f4e044f7-f11a-4b3d-9279-06c3976d6b87 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:08.034176 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f4e044f7-f11a-4b3d-9279-06c3976d6b87 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:08.041048 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f4e044f7-f11a-4b3d-9279-06c3976d6b87 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:08.041925 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f4e044f7-f11a-4b3d-9279-06c3976d6b87 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:08.042366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f4e044f7-f11a-4b3d-9279-06c3976d6b87 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:08.043052 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f4e044f7-f11a-4b3d-9279-06c3976d6b87 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:08.043502 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f4e044f7-f11a-4b3d-9279-06c3976d6b87 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:08.043951 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f4e044f7-f11a-4b3d-9279-06c3976d6b87 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:08.236417 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f4e044f7-f11a-4b3d-9279-06c3976d6b87 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:08.244439 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f4e044f7-f11a-4b3d-9279-06c3976d6b87 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1367 microversion: 2.1 time: 0.215613 Aug 26 15:57:08.250616 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 417/840] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:08 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:08.273582 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-aafb07f2-8a03-41f2-9698-84497f2c44c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:08.274318 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-aafb07f2-8a03-41f2-9698-84497f2c44c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:08.280797 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aafb07f2-8a03-41f2-9698-84497f2c44c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:08.281400 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aafb07f2-8a03-41f2-9698-84497f2c44c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:08.281841 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aafb07f2-8a03-41f2-9698-84497f2c44c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:08.282537 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aafb07f2-8a03-41f2-9698-84497f2c44c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:08.282989 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aafb07f2-8a03-41f2-9698-84497f2c44c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:08.283411 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aafb07f2-8a03-41f2-9698-84497f2c44c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:08.346958 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-eb8576a8-9f98-420e-a918-ba1329c8523d req-91c6613f-c637-4b43-9a30-762441eb68b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "328fd5f1-9e47-43b3-aea0-a3246130ff2c", "tag": "b9879cfe-fc48-49ee-b340-611f099b4e9b"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:08.356945 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-eb8576a8-9f98-420e-a918-ba1329c8523d req-91c6613f-c637-4b43-9a30-762441eb68b6 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:08.357817 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-eb8576a8-9f98-420e-a918-ba1329c8523d req-91c6613f-c637-4b43-9a30-762441eb68b6 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:08.358406 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-eb8576a8-9f98-420e-a918-ba1329c8523d req-91c6613f-c637-4b43-9a30-762441eb68b6 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:08.371378 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-eb8576a8-9f98-420e-a918-ba1329c8523d req-91c6613f-c637-4b43-9a30-762441eb68b6 service nova] Creating event network-changed:b9879cfe-fc48-49ee-b340-611f099b4e9b for instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c on hv-cinder-83124 Aug 26 15:57:08.376034 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-eb8576a8-9f98-420e-a918-ba1329c8523d req-91c6613f-c637-4b43-9a30-762441eb68b6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039332 Aug 26 15:57:08.377211 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 418/841] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:08.421271 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-aafb07f2-8a03-41f2-9698-84497f2c44c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:08.430272 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-aafb07f2-8a03-41f2-9698-84497f2c44c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:08.431546 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-aafb07f2-8a03-41f2-9698-84497f2c44c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:08.432756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-aafb07f2-8a03-41f2-9698-84497f2c44c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1724 microversion: 2.20 time: 0.163614 Aug 26 15:57:08.433642 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 424/842] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:08 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:57:09.279858 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-41f196b2-2972-4cca-9ae8-f257e121ce8f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:09.280567 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-41f196b2-2972-4cca-9ae8-f257e121ce8f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:09.286695 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41f196b2-2972-4cca-9ae8-f257e121ce8f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:09.287756 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41f196b2-2972-4cca-9ae8-f257e121ce8f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:09.288349 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41f196b2-2972-4cca-9ae8-f257e121ce8f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:09.288978 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41f196b2-2972-4cca-9ae8-f257e121ce8f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:09.289428 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41f196b2-2972-4cca-9ae8-f257e121ce8f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:09.289833 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-41f196b2-2972-4cca-9ae8-f257e121ce8f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:09.419375 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-41f196b2-2972-4cca-9ae8-f257e121ce8f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:09.427378 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-41f196b2-2972-4cca-9ae8-f257e121ce8f tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1367 microversion: 2.1 time: 0.152214 Aug 26 15:57:09.427957 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 419/843] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:09 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:09.469943 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-125819c1-e7c2-4cd7-86bc-2adb9d76691a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:09.470579 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-125819c1-e7c2-4cd7-86bc-2adb9d76691a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:09.477815 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-125819c1-e7c2-4cd7-86bc-2adb9d76691a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:09.478295 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-125819c1-e7c2-4cd7-86bc-2adb9d76691a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:09.478726 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-125819c1-e7c2-4cd7-86bc-2adb9d76691a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:09.479472 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-125819c1-e7c2-4cd7-86bc-2adb9d76691a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:09.479951 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-125819c1-e7c2-4cd7-86bc-2adb9d76691a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:09.480377 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-125819c1-e7c2-4cd7-86bc-2adb9d76691a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:09.609793 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-125819c1-e7c2-4cd7-86bc-2adb9d76691a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:09.619533 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-125819c1-e7c2-4cd7-86bc-2adb9d76691a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:09.619810 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-125819c1-e7c2-4cd7-86bc-2adb9d76691a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:09.620814 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-125819c1-e7c2-4cd7-86bc-2adb9d76691a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1724 microversion: 2.20 time: 0.154830 Aug 26 15:57:09.621375 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 425/844] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:09 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:10.448675 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e1cd5aa0-74e1-4f5a-836c-784e84b3ed32 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:10.449315 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e1cd5aa0-74e1-4f5a-836c-784e84b3ed32 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:10.456172 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e1cd5aa0-74e1-4f5a-836c-784e84b3ed32 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:10.456583 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e1cd5aa0-74e1-4f5a-836c-784e84b3ed32 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:10.457016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e1cd5aa0-74e1-4f5a-836c-784e84b3ed32 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:10.457700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e1cd5aa0-74e1-4f5a-836c-784e84b3ed32 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:10.458150 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e1cd5aa0-74e1-4f5a-836c-784e84b3ed32 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:10.458572 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e1cd5aa0-74e1-4f5a-836c-784e84b3ed32 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:10.593121 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e1cd5aa0-74e1-4f5a-836c-784e84b3ed32 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:10.596677 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:10.601644 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e1cd5aa0-74e1-4f5a-836c-784e84b3ed32 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1367 microversion: 2.1 time: 0.156753 Aug 26 15:57:10.602211 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 420/845] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:10 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:10.643442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d664680a-3dd5-467e-9afc-78ab3300ded6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:10.644080 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d664680a-3dd5-467e-9afc-78ab3300ded6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:10.650585 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d664680a-3dd5-467e-9afc-78ab3300ded6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:10.651063 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d664680a-3dd5-467e-9afc-78ab3300ded6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:10.654842 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d664680a-3dd5-467e-9afc-78ab3300ded6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:10.654842 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d664680a-3dd5-467e-9afc-78ab3300ded6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:10.654842 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d664680a-3dd5-467e-9afc-78ab3300ded6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:10.654842 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d664680a-3dd5-467e-9afc-78ab3300ded6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:10.785319 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d664680a-3dd5-467e-9afc-78ab3300ded6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:10.793978 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d664680a-3dd5-467e-9afc-78ab3300ded6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:10.795404 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d664680a-3dd5-467e-9afc-78ab3300ded6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:10.796615 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d664680a-3dd5-467e-9afc-78ab3300ded6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1724 microversion: 2.20 time: 0.157115 Aug 26 15:57:10.797183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 426/846] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:10 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:11.622344 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-27edf3fb-0597-42ce-b319-7b115bc5c110 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:11.622954 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-27edf3fb-0597-42ce-b319-7b115bc5c110 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:11.639652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27edf3fb-0597-42ce-b319-7b115bc5c110 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:11.639652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27edf3fb-0597-42ce-b319-7b115bc5c110 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:11.639652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27edf3fb-0597-42ce-b319-7b115bc5c110 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:11.639652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27edf3fb-0597-42ce-b319-7b115bc5c110 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:11.640150 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27edf3fb-0597-42ce-b319-7b115bc5c110 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:11.640150 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-27edf3fb-0597-42ce-b319-7b115bc5c110 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:11.773396 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-27edf3fb-0597-42ce-b319-7b115bc5c110 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:11.780873 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-27edf3fb-0597-42ce-b319-7b115bc5c110 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1367 microversion: 2.1 time: 0.162492 Aug 26 15:57:11.781436 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 421/847] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:11 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:11.819396 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-cf9ec434-465a-4043-9073-19434f44bd87 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:11.820114 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-cf9ec434-465a-4043-9073-19434f44bd87 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:11.826643 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf9ec434-465a-4043-9073-19434f44bd87 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:11.827282 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf9ec434-465a-4043-9073-19434f44bd87 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:11.827726 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf9ec434-465a-4043-9073-19434f44bd87 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:11.828707 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf9ec434-465a-4043-9073-19434f44bd87 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:11.829164 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf9ec434-465a-4043-9073-19434f44bd87 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:11.829597 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf9ec434-465a-4043-9073-19434f44bd87 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:11.962449 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cf9ec434-465a-4043-9073-19434f44bd87 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:11.970712 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cf9ec434-465a-4043-9073-19434f44bd87 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:11.972205 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cf9ec434-465a-4043-9073-19434f44bd87 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:11.973366 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-cf9ec434-465a-4043-9073-19434f44bd87 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1724 microversion: 2.20 time: 0.158709 Aug 26 15:57:11.973920 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 427/848] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:11 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:12.802027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4ea04c75-7bcb-4d22-b614-0fde75fb344d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:12.802578 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-4ea04c75-7bcb-4d22-b614-0fde75fb344d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:12.810348 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4ea04c75-7bcb-4d22-b614-0fde75fb344d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:12.810825 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4ea04c75-7bcb-4d22-b614-0fde75fb344d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:12.811253 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4ea04c75-7bcb-4d22-b614-0fde75fb344d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:12.811954 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4ea04c75-7bcb-4d22-b614-0fde75fb344d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:12.812400 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4ea04c75-7bcb-4d22-b614-0fde75fb344d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:12.812815 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4ea04c75-7bcb-4d22-b614-0fde75fb344d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:12.941058 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4ea04c75-7bcb-4d22-b614-0fde75fb344d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:12.948783 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4ea04c75-7bcb-4d22-b614-0fde75fb344d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1367 microversion: 2.1 time: 0.150901 Aug 26 15:57:12.949349 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 422/849] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:12 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:12.997306 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-ad658d27-636d-4cde-951e-eeccf93b1b6e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:12.997915 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ad658d27-636d-4cde-951e-eeccf93b1b6e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:13.004368 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ad658d27-636d-4cde-951e-eeccf93b1b6e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:13.004844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ad658d27-636d-4cde-951e-eeccf93b1b6e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:13.005276 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ad658d27-636d-4cde-951e-eeccf93b1b6e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:13.005985 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ad658d27-636d-4cde-951e-eeccf93b1b6e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:13.006461 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ad658d27-636d-4cde-951e-eeccf93b1b6e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:13.006880 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ad658d27-636d-4cde-951e-eeccf93b1b6e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:13.142013 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ad658d27-636d-4cde-951e-eeccf93b1b6e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:13.150772 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ad658d27-636d-4cde-951e-eeccf93b1b6e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:13.152240 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ad658d27-636d-4cde-951e-eeccf93b1b6e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:13.153507 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-ad658d27-636d-4cde-951e-eeccf93b1b6e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1724 microversion: 2.20 time: 0.160153 Aug 26 15:57:13.154063 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 428/850] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:12 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:13.628726 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-360ad6a2-741d-4143-b10d-03e1fd3115bc req-118eb480-9e26-4ecc-9c8f-183f6074c5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328fd5f1-9e47-43b3-aea0-a3246130ff2c", "name": "network-vif-plugged", "status": "completed", "tag": "b9879cfe-fc48-49ee-b340-611f099b4e9b"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:13.637065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:13.637065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=6 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:13.646027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-360ad6a2-741d-4143-b10d-03e1fd3115bc req-118eb480-9e26-4ecc-9c8f-183f6074c5ff service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:13.647162 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-360ad6a2-741d-4143-b10d-03e1fd3115bc req-118eb480-9e26-4ecc-9c8f-183f6074c5ff service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:13.647596 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-360ad6a2-741d-4143-b10d-03e1fd3115bc req-118eb480-9e26-4ecc-9c8f-183f6074c5ff service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:13.659556 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-360ad6a2-741d-4143-b10d-03e1fd3115bc req-118eb480-9e26-4ecc-9c8f-183f6074c5ff service nova] Creating event network-vif-plugged:b9879cfe-fc48-49ee-b340-611f099b4e9b for instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c on hv-cinder-83124 Aug 26 15:57:13.664463 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-360ad6a2-741d-4143-b10d-03e1fd3115bc req-118eb480-9e26-4ecc-9c8f-183f6074c5ff service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041103 Aug 26 15:57:13.665852 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 423/851] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:13.970152 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-25e490d8-bc5f-460c-bb0f-4a8d81512c83 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:13.970767 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-25e490d8-bc5f-460c-bb0f-4a8d81512c83 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:13.972644 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=6 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:13.977418 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-25e490d8-bc5f-460c-bb0f-4a8d81512c83 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:13.977900 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-25e490d8-bc5f-460c-bb0f-4a8d81512c83 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:13.978335 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-25e490d8-bc5f-460c-bb0f-4a8d81512c83 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:13.979132 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-25e490d8-bc5f-460c-bb0f-4a8d81512c83 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:13.979583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-25e490d8-bc5f-460c-bb0f-4a8d81512c83 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:13.980052 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-25e490d8-bc5f-460c-bb0f-4a8d81512c83 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:14.111644 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-25e490d8-bc5f-460c-bb0f-4a8d81512c83 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:14.120527 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-25e490d8-bc5f-460c-bb0f-4a8d81512c83 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1367 microversion: 2.1 time: 0.154239 Aug 26 15:57:14.128906 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 429/852] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:13 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:14.179125 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3a796cc0-f7a7-4ee7-9754-8dcbbc83a1f7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:14.179821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3a796cc0-f7a7-4ee7-9754-8dcbbc83a1f7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:14.187125 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3a796cc0-f7a7-4ee7-9754-8dcbbc83a1f7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:14.187611 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3a796cc0-f7a7-4ee7-9754-8dcbbc83a1f7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:14.188080 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3a796cc0-f7a7-4ee7-9754-8dcbbc83a1f7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:14.188789 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3a796cc0-f7a7-4ee7-9754-8dcbbc83a1f7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:14.189228 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3a796cc0-f7a7-4ee7-9754-8dcbbc83a1f7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:14.189653 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3a796cc0-f7a7-4ee7-9754-8dcbbc83a1f7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:14.321938 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3a796cc0-f7a7-4ee7-9754-8dcbbc83a1f7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:14.330392 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3a796cc0-f7a7-4ee7-9754-8dcbbc83a1f7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:14.331840 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3a796cc0-f7a7-4ee7-9754-8dcbbc83a1f7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:14.333022 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3a796cc0-f7a7-4ee7-9754-8dcbbc83a1f7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1724 microversion: 2.20 time: 0.159370 Aug 26 15:57:14.333581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 424/853] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:14 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:15.142330 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-378d9157-ff78-417f-b3a4-862c727d079d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:15.142907 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-378d9157-ff78-417f-b3a4-862c727d079d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:15.150045 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-378d9157-ff78-417f-b3a4-862c727d079d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:15.150521 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-378d9157-ff78-417f-b3a4-862c727d079d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:15.150953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-378d9157-ff78-417f-b3a4-862c727d079d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:15.151638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-378d9157-ff78-417f-b3a4-862c727d079d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:15.152186 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-378d9157-ff78-417f-b3a4-862c727d079d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:15.152609 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-378d9157-ff78-417f-b3a4-862c727d079d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:15.286814 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-378d9157-ff78-417f-b3a4-862c727d079d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:15.294353 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-378d9157-ff78-417f-b3a4-862c727d079d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1367 microversion: 2.1 time: 0.156461 Aug 26 15:57:15.294920 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 430/854] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:15 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:15.356855 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7926e2e9-4b39-4b64-ba10-56df138d64e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:15.357470 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7926e2e9-4b39-4b64-ba10-56df138d64e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:15.364120 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7926e2e9-4b39-4b64-ba10-56df138d64e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:15.364603 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7926e2e9-4b39-4b64-ba10-56df138d64e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:15.365040 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7926e2e9-4b39-4b64-ba10-56df138d64e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:15.366260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7926e2e9-4b39-4b64-ba10-56df138d64e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:15.366990 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7926e2e9-4b39-4b64-ba10-56df138d64e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:15.367114 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7926e2e9-4b39-4b64-ba10-56df138d64e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:15.498422 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7926e2e9-4b39-4b64-ba10-56df138d64e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:15.507161 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7926e2e9-4b39-4b64-ba10-56df138d64e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:15.508694 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7926e2e9-4b39-4b64-ba10-56df138d64e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:15.509850 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7926e2e9-4b39-4b64-ba10-56df138d64e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1724 microversion: 2.20 time: 0.156942 Aug 26 15:57:15.510409 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 425/855] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:15 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:16.317837 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f948768a-3bea-4078-aaba-1422e2523eae tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:16.319268 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f948768a-3bea-4078-aaba-1422e2523eae tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:16.331006 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f948768a-3bea-4078-aaba-1422e2523eae tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:16.331527 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f948768a-3bea-4078-aaba-1422e2523eae tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:16.332016 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f948768a-3bea-4078-aaba-1422e2523eae tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:16.332734 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f948768a-3bea-4078-aaba-1422e2523eae tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:16.333185 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f948768a-3bea-4078-aaba-1422e2523eae tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:16.333704 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f948768a-3bea-4078-aaba-1422e2523eae tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:16.466052 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f948768a-3bea-4078-aaba-1422e2523eae tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:16.473686 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f948768a-3bea-4078-aaba-1422e2523eae tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1556 microversion: 2.1 time: 0.159752 Aug 26 15:57:16.479239 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 431/856] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:16 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:16.494944 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-6cc26462-b629-442c-856d-18a6d78605b3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:16.495469 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-6cc26462-b629-442c-856d-18a6d78605b3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:16.504349 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6cc26462-b629-442c-856d-18a6d78605b3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:16.504836 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6cc26462-b629-442c-856d-18a6d78605b3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:16.505272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6cc26462-b629-442c-856d-18a6d78605b3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:16.506076 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6cc26462-b629-442c-856d-18a6d78605b3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:16.506535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6cc26462-b629-442c-856d-18a6d78605b3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:16.506961 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6cc26462-b629-442c-856d-18a6d78605b3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:16.533090 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6392cc94-53b1-40a4-ba58-265364bf1eab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:16.533694 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6392cc94-53b1-40a4-ba58-265364bf1eab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:16.540092 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6392cc94-53b1-40a4-ba58-265364bf1eab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:16.540594 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6392cc94-53b1-40a4-ba58-265364bf1eab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:16.541020 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6392cc94-53b1-40a4-ba58-265364bf1eab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:16.541714 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6392cc94-53b1-40a4-ba58-265364bf1eab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:16.542153 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6392cc94-53b1-40a4-ba58-265364bf1eab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:16.542569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6392cc94-53b1-40a4-ba58-265364bf1eab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:16.591022 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-6cc26462-b629-442c-856d-18a6d78605b3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100495 Aug 26 15:57:16.591699 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 426/857] 10.222.0.98 () {58 vars in 1275 bytes} [Fri Aug 26 15:57:16 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:16.692985 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6392cc94-53b1-40a4-ba58-265364bf1eab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:16.697564 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=100 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:16.703365 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6392cc94-53b1-40a4-ba58-265364bf1eab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:16.705058 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6392cc94-53b1-40a4-ba58-265364bf1eab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:16.706231 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6392cc94-53b1-40a4-ba58-265364bf1eab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1724 microversion: 2.20 time: 0.177114 Aug 26 15:57:16.706783 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 432/858] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:16 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:17.730257 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f2004367-bb77-44dd-b99c-9f5451e35ed5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:17.730928 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f2004367-bb77-44dd-b99c-9f5451e35ed5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:17.737354 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2004367-bb77-44dd-b99c-9f5451e35ed5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:17.737840 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2004367-bb77-44dd-b99c-9f5451e35ed5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:17.738272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2004367-bb77-44dd-b99c-9f5451e35ed5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:17.739071 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2004367-bb77-44dd-b99c-9f5451e35ed5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:17.739524 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2004367-bb77-44dd-b99c-9f5451e35ed5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:17.739972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f2004367-bb77-44dd-b99c-9f5451e35ed5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:18.200411 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-968d96c1-3f4a-4572-880e-e26a81a45a02 req-0f26e470-c3d5-4d68-b183-7d1c32571e58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "328fd5f1-9e47-43b3-aea0-a3246130ff2c", "tag": "b9879cfe-fc48-49ee-b340-611f099b4e9b"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:18.205396 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f2004367-bb77-44dd-b99c-9f5451e35ed5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:18.215344 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-968d96c1-3f4a-4572-880e-e26a81a45a02 req-0f26e470-c3d5-4d68-b183-7d1c32571e58 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:18.215735 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-968d96c1-3f4a-4572-880e-e26a81a45a02 req-0f26e470-c3d5-4d68-b183-7d1c32571e58 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:18.216409 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-968d96c1-3f4a-4572-880e-e26a81a45a02 req-0f26e470-c3d5-4d68-b183-7d1c32571e58 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:18.220121 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f2004367-bb77-44dd-b99c-9f5451e35ed5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:18.221586 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f2004367-bb77-44dd-b99c-9f5451e35ed5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:18.222764 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f2004367-bb77-44dd-b99c-9f5451e35ed5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1724 microversion: 2.20 time: 0.497180 Aug 26 15:57:18.229285 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-968d96c1-3f4a-4572-880e-e26a81a45a02 req-0f26e470-c3d5-4d68-b183-7d1c32571e58 service nova] Creating event network-changed:b9879cfe-fc48-49ee-b340-611f099b4e9b for instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c on hv-cinder-83124 Aug 26 15:57:18.240682 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 427/859] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:17 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1724 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:57:18.241600 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-968d96c1-3f4a-4572-880e-e26a81a45a02 req-0f26e470-c3d5-4d68-b183-7d1c32571e58 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046885 Aug 26 15:57:18.242288 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 433/860] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:19.247264 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a8c58ecf-01fb-454d-a14f-0da383d35b56 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:19.248019 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a8c58ecf-01fb-454d-a14f-0da383d35b56 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:19.251556 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:19.254974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a8c58ecf-01fb-454d-a14f-0da383d35b56 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:19.255457 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a8c58ecf-01fb-454d-a14f-0da383d35b56 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:19.256508 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a8c58ecf-01fb-454d-a14f-0da383d35b56 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:19.257203 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a8c58ecf-01fb-454d-a14f-0da383d35b56 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:19.257657 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a8c58ecf-01fb-454d-a14f-0da383d35b56 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:19.258081 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a8c58ecf-01fb-454d-a14f-0da383d35b56 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:19.432444 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-a8c58ecf-01fb-454d-a14f-0da383d35b56 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:19.442826 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-a8c58ecf-01fb-454d-a14f-0da383d35b56 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:19.444674 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-a8c58ecf-01fb-454d-a14f-0da383d35b56 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:19.445911 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-a8c58ecf-01fb-454d-a14f-0da383d35b56 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1745 microversion: 2.20 time: 0.203627 Aug 26 15:57:19.446488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 428/861] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:19 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1745 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:20.474771 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e9956225-2b30-4854-9488-9996d0a8a8e0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:20.475457 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e9956225-2b30-4854-9488-9996d0a8a8e0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:20.481584 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e9956225-2b30-4854-9488-9996d0a8a8e0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:20.482060 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e9956225-2b30-4854-9488-9996d0a8a8e0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:20.482489 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e9956225-2b30-4854-9488-9996d0a8a8e0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:20.483179 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e9956225-2b30-4854-9488-9996d0a8a8e0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:20.483627 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e9956225-2b30-4854-9488-9996d0a8a8e0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:20.484099 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e9956225-2b30-4854-9488-9996d0a8a8e0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:20.630133 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e9956225-2b30-4854-9488-9996d0a8a8e0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:20.639161 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e9956225-2b30-4854-9488-9996d0a8a8e0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:20.640702 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e9956225-2b30-4854-9488-9996d0a8a8e0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:20.641858 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e9956225-2b30-4854-9488-9996d0a8a8e0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1745 microversion: 2.20 time: 0.171836 Aug 26 15:57:20.642412 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 434/862] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:20 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:21.611710 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-0797e1f2-63d9-4d4a-8ca8-fb3b652fb008 req-76a2b853-429d-4f9b-82d0-727a6fcaaa3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6825d4-cc4d-4688-9532-01a6cee66ea2", "name": "network-vif-plugged", "status": "completed", "tag": "57bf8f97-285e-4041-93e6-6c458f946244"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:21.623393 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-0797e1f2-63d9-4d4a-8ca8-fb3b652fb008 req-76a2b853-429d-4f9b-82d0-727a6fcaaa3e service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:21.623896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-0797e1f2-63d9-4d4a-8ca8-fb3b652fb008 req-76a2b853-429d-4f9b-82d0-727a6fcaaa3e service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:21.624350 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-0797e1f2-63d9-4d4a-8ca8-fb3b652fb008 req-76a2b853-429d-4f9b-82d0-727a6fcaaa3e service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:21.638180 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-0797e1f2-63d9-4d4a-8ca8-fb3b652fb008 req-76a2b853-429d-4f9b-82d0-727a6fcaaa3e service nova] Creating event network-vif-plugged:57bf8f97-285e-4041-93e6-6c458f946244 for instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 on hv-cinder-83124 Aug 26 15:57:21.643467 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-0797e1f2-63d9-4d4a-8ca8-fb3b652fb008 req-76a2b853-429d-4f9b-82d0-727a6fcaaa3e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038189 Aug 26 15:57:21.644440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 429/863] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:21.665456 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-be6d972f-3ecb-405d-bc9d-5858d73092bf tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:21.666238 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-be6d972f-3ecb-405d-bc9d-5858d73092bf tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:21.672844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-be6d972f-3ecb-405d-bc9d-5858d73092bf tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:21.673620 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-be6d972f-3ecb-405d-bc9d-5858d73092bf tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:21.674127 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-be6d972f-3ecb-405d-bc9d-5858d73092bf tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:21.674901 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-be6d972f-3ecb-405d-bc9d-5858d73092bf tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:21.675433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-be6d972f-3ecb-405d-bc9d-5858d73092bf tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:21.676006 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-be6d972f-3ecb-405d-bc9d-5858d73092bf tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:21.826099 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-be6d972f-3ecb-405d-bc9d-5858d73092bf tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:21.836973 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-be6d972f-3ecb-405d-bc9d-5858d73092bf tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:21.838674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-be6d972f-3ecb-405d-bc9d-5858d73092bf tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:21.839908 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-be6d972f-3ecb-405d-bc9d-5858d73092bf tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1740 microversion: 2.20 time: 0.178976 Aug 26 15:57:21.840510 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 435/864] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:21 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:22.865694 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-53bbf881-033d-4628-8eb9-1c1478e44011 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:22.866376 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-53bbf881-033d-4628-8eb9-1c1478e44011 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:22.880636 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-53bbf881-033d-4628-8eb9-1c1478e44011 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:22.881820 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-53bbf881-033d-4628-8eb9-1c1478e44011 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:22.882266 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-53bbf881-033d-4628-8eb9-1c1478e44011 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:22.883026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-53bbf881-033d-4628-8eb9-1c1478e44011 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:22.883645 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-53bbf881-033d-4628-8eb9-1c1478e44011 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:22.884095 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-53bbf881-033d-4628-8eb9-1c1478e44011 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:23.069532 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-53bbf881-033d-4628-8eb9-1c1478e44011 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:23.078764 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-53bbf881-033d-4628-8eb9-1c1478e44011 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:23.083102 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-53bbf881-033d-4628-8eb9-1c1478e44011 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:23.083102 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-53bbf881-033d-4628-8eb9-1c1478e44011 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1740 microversion: 2.20 time: 0.220798 Aug 26 15:57:23.083102 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 430/865] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:22 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:24.104507 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-31e4f98e-2acd-4c9e-bc92-7178e7b888eb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:24.105866 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-31e4f98e-2acd-4c9e-bc92-7178e7b888eb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:24.113640 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-31e4f98e-2acd-4c9e-bc92-7178e7b888eb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:24.114413 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-31e4f98e-2acd-4c9e-bc92-7178e7b888eb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:24.115091 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-31e4f98e-2acd-4c9e-bc92-7178e7b888eb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:24.116107 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-31e4f98e-2acd-4c9e-bc92-7178e7b888eb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:24.116775 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-31e4f98e-2acd-4c9e-bc92-7178e7b888eb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:24.117654 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-31e4f98e-2acd-4c9e-bc92-7178e7b888eb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:24.289212 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-31e4f98e-2acd-4c9e-bc92-7178e7b888eb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:24.299834 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-31e4f98e-2acd-4c9e-bc92-7178e7b888eb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:24.301681 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-31e4f98e-2acd-4c9e-bc92-7178e7b888eb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:24.303942 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-31e4f98e-2acd-4c9e-bc92-7178e7b888eb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1740 microversion: 2.20 time: 0.202841 Aug 26 15:57:24.305013 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 436/866] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:24 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:25.328374 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-628618dd-60b6-4bcd-9700-65cc89a42d01 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:25.329898 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-628618dd-60b6-4bcd-9700-65cc89a42d01 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:25.337721 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-628618dd-60b6-4bcd-9700-65cc89a42d01 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:25.338349 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-628618dd-60b6-4bcd-9700-65cc89a42d01 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:25.339036 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-628618dd-60b6-4bcd-9700-65cc89a42d01 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:25.339908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-628618dd-60b6-4bcd-9700-65cc89a42d01 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:25.340579 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-628618dd-60b6-4bcd-9700-65cc89a42d01 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:25.341112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-628618dd-60b6-4bcd-9700-65cc89a42d01 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:25.484866 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-628618dd-60b6-4bcd-9700-65cc89a42d01 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:25.494541 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-628618dd-60b6-4bcd-9700-65cc89a42d01 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:25.496541 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-628618dd-60b6-4bcd-9700-65cc89a42d01 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:25.497739 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-628618dd-60b6-4bcd-9700-65cc89a42d01 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1740 microversion: 2.20 time: 0.173993 Aug 26 15:57:25.498845 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 431/867] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:25 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:26.536559 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a1990623-cb42-4071-9cb1-550e76b083c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:26.539786 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a1990623-cb42-4071-9cb1-550e76b083c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:26.551171 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1990623-cb42-4071-9cb1-550e76b083c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:26.551171 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1990623-cb42-4071-9cb1-550e76b083c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:26.551171 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1990623-cb42-4071-9cb1-550e76b083c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:26.551171 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1990623-cb42-4071-9cb1-550e76b083c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:26.551637 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1990623-cb42-4071-9cb1-550e76b083c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:26.551637 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a1990623-cb42-4071-9cb1-550e76b083c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:26.740595 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a1990623-cb42-4071-9cb1-550e76b083c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:26.749521 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a1990623-cb42-4071-9cb1-550e76b083c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:26.751364 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a1990623-cb42-4071-9cb1-550e76b083c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:26.753319 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a1990623-cb42-4071-9cb1-550e76b083c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1740 microversion: 2.20 time: 0.221535 Aug 26 15:57:26.754657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 437/868] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:26 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:27.778787 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-66f18204-6f09-48c0-8bc9-e2b55f24183c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:27.779530 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-66f18204-6f09-48c0-8bc9-e2b55f24183c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:27.786147 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66f18204-6f09-48c0-8bc9-e2b55f24183c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:27.786636 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66f18204-6f09-48c0-8bc9-e2b55f24183c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:27.787118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66f18204-6f09-48c0-8bc9-e2b55f24183c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:27.787811 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66f18204-6f09-48c0-8bc9-e2b55f24183c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:27.788426 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66f18204-6f09-48c0-8bc9-e2b55f24183c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:27.788849 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-66f18204-6f09-48c0-8bc9-e2b55f24183c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:27.921962 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-66f18204-6f09-48c0-8bc9-e2b55f24183c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:27.930409 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-66f18204-6f09-48c0-8bc9-e2b55f24183c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:27.931849 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-66f18204-6f09-48c0-8bc9-e2b55f24183c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:27.933038 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-66f18204-6f09-48c0-8bc9-e2b55f24183c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1740 microversion: 2.20 time: 0.158443 Aug 26 15:57:27.933581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 432/869] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:27 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:28.957302 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-18d55e22-a804-453b-a1d8-e7ac3e4219d2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:28.957851 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-18d55e22-a804-453b-a1d8-e7ac3e4219d2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:28.971899 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18d55e22-a804-453b-a1d8-e7ac3e4219d2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:28.972547 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18d55e22-a804-453b-a1d8-e7ac3e4219d2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:28.972993 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18d55e22-a804-453b-a1d8-e7ac3e4219d2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:28.973705 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18d55e22-a804-453b-a1d8-e7ac3e4219d2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:28.974165 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18d55e22-a804-453b-a1d8-e7ac3e4219d2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:28.977947 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18d55e22-a804-453b-a1d8-e7ac3e4219d2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:29.254227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-18d55e22-a804-453b-a1d8-e7ac3e4219d2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:29.277359 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-18d55e22-a804-453b-a1d8-e7ac3e4219d2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:29.278935 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-18d55e22-a804-453b-a1d8-e7ac3e4219d2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:29.280199 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-18d55e22-a804-453b-a1d8-e7ac3e4219d2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1740 microversion: 2.20 time: 0.327641 Aug 26 15:57:29.295085 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 438/870] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:28 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1740 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:30.309391 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e44c89d8-50d4-4a03-9b8c-693b1246cd92 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:30.310005 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e44c89d8-50d4-4a03-9b8c-693b1246cd92 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:30.319973 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e44c89d8-50d4-4a03-9b8c-693b1246cd92 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:30.324790 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e44c89d8-50d4-4a03-9b8c-693b1246cd92 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:30.325364 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e44c89d8-50d4-4a03-9b8c-693b1246cd92 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:30.327049 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e44c89d8-50d4-4a03-9b8c-693b1246cd92 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:30.327847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e44c89d8-50d4-4a03-9b8c-693b1246cd92 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:30.330308 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e44c89d8-50d4-4a03-9b8c-693b1246cd92 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:30.660929 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e44c89d8-50d4-4a03-9b8c-693b1246cd92 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:30.672222 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e44c89d8-50d4-4a03-9b8c-693b1246cd92 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:30.673452 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e44c89d8-50d4-4a03-9b8c-693b1246cd92 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:30.675923 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e44c89d8-50d4-4a03-9b8c-693b1246cd92 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1740 microversion: 2.20 time: 0.372387 Aug 26 15:57:30.688937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 433/871] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:30 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1740 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:31.698680 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6ad4d69a-a9d4-4a07-8bd2-dc8e63c3cf36 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:31.699293 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6ad4d69a-a9d4-4a07-8bd2-dc8e63c3cf36 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:31.706838 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6ad4d69a-a9d4-4a07-8bd2-dc8e63c3cf36 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:31.711898 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6ad4d69a-a9d4-4a07-8bd2-dc8e63c3cf36 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:31.711898 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6ad4d69a-a9d4-4a07-8bd2-dc8e63c3cf36 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:31.711898 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6ad4d69a-a9d4-4a07-8bd2-dc8e63c3cf36 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:31.711898 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6ad4d69a-a9d4-4a07-8bd2-dc8e63c3cf36 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:31.712968 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6ad4d69a-a9d4-4a07-8bd2-dc8e63c3cf36 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:31.865000 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6ad4d69a-a9d4-4a07-8bd2-dc8e63c3cf36 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:31.875604 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6ad4d69a-a9d4-4a07-8bd2-dc8e63c3cf36 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:31.877625 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6ad4d69a-a9d4-4a07-8bd2-dc8e63c3cf36 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:31.879042 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6ad4d69a-a9d4-4a07-8bd2-dc8e63c3cf36 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1740 microversion: 2.20 time: 0.184357 Aug 26 15:57:31.880160 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 439/872] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:31 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:32.904759 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4798a922-357f-4c65-a69c-26c9f6d114c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:32.905367 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-4798a922-357f-4c65-a69c-26c9f6d114c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:32.912791 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4798a922-357f-4c65-a69c-26c9f6d114c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:32.912791 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4798a922-357f-4c65-a69c-26c9f6d114c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:32.913123 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4798a922-357f-4c65-a69c-26c9f6d114c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:32.913638 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4798a922-357f-4c65-a69c-26c9f6d114c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:32.914091 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4798a922-357f-4c65-a69c-26c9f6d114c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:32.914516 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4798a922-357f-4c65-a69c-26c9f6d114c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:33.060116 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4798a922-357f-4c65-a69c-26c9f6d114c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:33.068191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4798a922-357f-4c65-a69c-26c9f6d114c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:33.069617 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4798a922-357f-4c65-a69c-26c9f6d114c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:33.070793 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4798a922-357f-4c65-a69c-26c9f6d114c8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1740 microversion: 2.20 time: 0.169882 Aug 26 15:57:33.071335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 434/873] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:32 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:34.094998 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5f32165f-d306-4c2e-9144-78890dfa8689 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:34.095761 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5f32165f-d306-4c2e-9144-78890dfa8689 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:34.098412 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:34.103890 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5f32165f-d306-4c2e-9144-78890dfa8689 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:34.104470 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5f32165f-d306-4c2e-9144-78890dfa8689 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:34.104977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5f32165f-d306-4c2e-9144-78890dfa8689 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:34.105747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5f32165f-d306-4c2e-9144-78890dfa8689 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:34.106298 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5f32165f-d306-4c2e-9144-78890dfa8689 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:34.106735 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5f32165f-d306-4c2e-9144-78890dfa8689 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:34.257087 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5f32165f-d306-4c2e-9144-78890dfa8689 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:34.266053 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5f32165f-d306-4c2e-9144-78890dfa8689 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:34.267637 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5f32165f-d306-4c2e-9144-78890dfa8689 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:34.268934 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5f32165f-d306-4c2e-9144-78890dfa8689 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1722 microversion: 2.20 time: 0.178566 Aug 26 15:57:34.269575 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 440/874] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:34 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:35.292066 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-30c9bd21-a3e6-4db2-8ecd-a75d46e7a41a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:35.292652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-30c9bd21-a3e6-4db2-8ecd-a75d46e7a41a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:35.299063 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-30c9bd21-a3e6-4db2-8ecd-a75d46e7a41a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:35.299534 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-30c9bd21-a3e6-4db2-8ecd-a75d46e7a41a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:35.299999 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-30c9bd21-a3e6-4db2-8ecd-a75d46e7a41a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:35.300680 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-30c9bd21-a3e6-4db2-8ecd-a75d46e7a41a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:35.301119 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-30c9bd21-a3e6-4db2-8ecd-a75d46e7a41a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:35.301547 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-30c9bd21-a3e6-4db2-8ecd-a75d46e7a41a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:35.442145 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-30c9bd21-a3e6-4db2-8ecd-a75d46e7a41a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:35.451222 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-30c9bd21-a3e6-4db2-8ecd-a75d46e7a41a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:35.453008 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-30c9bd21-a3e6-4db2-8ecd-a75d46e7a41a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:35.454211 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-30c9bd21-a3e6-4db2-8ecd-a75d46e7a41a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1722 microversion: 2.20 time: 0.166035 Aug 26 15:57:35.454759 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 435/875] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:35 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:57:35.615392 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-59fc5b01-c605-4ea8-9046-dfeba46a0d14 req-577b30f8-9835-4883-8538-693bcac826fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6825d4-cc4d-4688-9532-01a6cee66ea2", "name": "network-vif-unplugged", "status": "completed", "tag": "57bf8f97-285e-4041-93e6-6c458f946244"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:35.626695 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-59fc5b01-c605-4ea8-9046-dfeba46a0d14 req-577b30f8-9835-4883-8538-693bcac826fd service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:35.627578 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-59fc5b01-c605-4ea8-9046-dfeba46a0d14 req-577b30f8-9835-4883-8538-693bcac826fd service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:35.627578 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-59fc5b01-c605-4ea8-9046-dfeba46a0d14 req-577b30f8-9835-4883-8538-693bcac826fd service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:35.641664 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-59fc5b01-c605-4ea8-9046-dfeba46a0d14 req-577b30f8-9835-4883-8538-693bcac826fd service nova] Creating event network-vif-unplugged:57bf8f97-285e-4041-93e6-6c458f946244 for instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 on hv-cinder-83124 Aug 26 15:57:35.645112 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-59fc5b01-c605-4ea8-9046-dfeba46a0d14 req-577b30f8-9835-4883-8538-693bcac826fd service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034356 Aug 26 15:57:35.645764 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 441/876] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:36.477986 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e5e881a0-8511-4bae-a2fd-6f99524fa77f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:36.478697 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e5e881a0-8511-4bae-a2fd-6f99524fa77f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:36.490476 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e5e881a0-8511-4bae-a2fd-6f99524fa77f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:36.490476 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e5e881a0-8511-4bae-a2fd-6f99524fa77f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:36.490476 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e5e881a0-8511-4bae-a2fd-6f99524fa77f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:36.490476 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e5e881a0-8511-4bae-a2fd-6f99524fa77f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:36.491204 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e5e881a0-8511-4bae-a2fd-6f99524fa77f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:36.491204 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e5e881a0-8511-4bae-a2fd-6f99524fa77f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:36.630987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e5e881a0-8511-4bae-a2fd-6f99524fa77f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:36.639272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e5e881a0-8511-4bae-a2fd-6f99524fa77f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:36.640750 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e5e881a0-8511-4bae-a2fd-6f99524fa77f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:36.641921 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e5e881a0-8511-4bae-a2fd-6f99524fa77f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1725 microversion: 2.20 time: 0.168278 Aug 26 15:57:36.642470 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 436/877] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:36 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:36.667694 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6c92f50c-095b-4f6c-a0d7-b145c512d3d0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6dfb4ca-b7a0-4ca2-a40b-5f7eadb34e47"}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:36.670204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6c92f50c-095b-4f6c-a0d7-b145c512d3d0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:36.676474 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6c92f50c-095b-4f6c-a0d7-b145c512d3d0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:36.677561 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6c92f50c-095b-4f6c-a0d7-b145c512d3d0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:36.677999 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6c92f50c-095b-4f6c-a0d7-b145c512d3d0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:36.678691 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6c92f50c-095b-4f6c-a0d7-b145c512d3d0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:36.679137 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6c92f50c-095b-4f6c-a0d7-b145c512d3d0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:36.679557 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6c92f50c-095b-4f6c-a0d7-b145c512d3d0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:37.724135 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6c92f50c-095b-4f6c-a0d7-b145c512d3d0 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "POST /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.060808 Aug 26 15:57:37.725336 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 442/878] 10.222.0.98 () {62 vars in 1364 bytes} [Fri Aug 26 15:57:36 2022] POST /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/os-volume_attachments => generated 188 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:57:37.850357 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-fac41cd6-ec1f-45eb-9eb6-46c94f5820c3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:37.850954 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-fac41cd6-ec1f-45eb-9eb6-46c94f5820c3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:37.857624 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fac41cd6-ec1f-45eb-9eb6-46c94f5820c3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:37.858107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fac41cd6-ec1f-45eb-9eb6-46c94f5820c3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:37.858578 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fac41cd6-ec1f-45eb-9eb6-46c94f5820c3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:37.859284 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fac41cd6-ec1f-45eb-9eb6-46c94f5820c3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:37.859730 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fac41cd6-ec1f-45eb-9eb6-46c94f5820c3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:37.860185 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fac41cd6-ec1f-45eb-9eb6-46c94f5820c3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:37.906188 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-fac41cd6-ec1f-45eb-9eb6-46c94f5820c3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127698) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 15:57:38.217406 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-fac41cd6-ec1f-45eb-9eb6-46c94f5820c3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "POST /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/action" status: 202 len: 0 microversion: 2.20 time: 0.371492 Aug 26 15:57:38.218094 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 437/879] 10.222.0.98 () {62 vars in 1319 bytes} [Fri Aug 26 15:57:37 2022] POST /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:57:38.226717 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-bbfc7dd7-a9f7-4720-81d2-5e22b6176bef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:38.227326 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-bbfc7dd7-a9f7-4720-81d2-5e22b6176bef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:38.234037 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bbfc7dd7-a9f7-4720-81d2-5e22b6176bef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:38.234511 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bbfc7dd7-a9f7-4720-81d2-5e22b6176bef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:38.234938 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bbfc7dd7-a9f7-4720-81d2-5e22b6176bef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:38.235624 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bbfc7dd7-a9f7-4720-81d2-5e22b6176bef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:38.236105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bbfc7dd7-a9f7-4720-81d2-5e22b6176bef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:38.236527 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bbfc7dd7-a9f7-4720-81d2-5e22b6176bef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:38.374518 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-bbfc7dd7-a9f7-4720-81d2-5e22b6176bef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:38.384171 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-bbfc7dd7-a9f7-4720-81d2-5e22b6176bef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:38.385611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-bbfc7dd7-a9f7-4720-81d2-5e22b6176bef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:38.395256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-bbfc7dd7-a9f7-4720-81d2-5e22b6176bef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1751 microversion: 2.20 time: 0.164576 Aug 26 15:57:38.395256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 443/880] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:38 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:39.411800 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-92cb1d20-e3fd-4494-8b8f-fdcaa014a05f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:39.412447 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-92cb1d20-e3fd-4494-8b8f-fdcaa014a05f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:39.418692 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-92cb1d20-e3fd-4494-8b8f-fdcaa014a05f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:39.419180 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-92cb1d20-e3fd-4494-8b8f-fdcaa014a05f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:39.419620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-92cb1d20-e3fd-4494-8b8f-fdcaa014a05f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:39.420364 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-92cb1d20-e3fd-4494-8b8f-fdcaa014a05f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:39.420816 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-92cb1d20-e3fd-4494-8b8f-fdcaa014a05f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:39.421242 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-92cb1d20-e3fd-4494-8b8f-fdcaa014a05f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:39.425516 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:39.611167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-92cb1d20-e3fd-4494-8b8f-fdcaa014a05f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:39.629012 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-92cb1d20-e3fd-4494-8b8f-fdcaa014a05f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:39.631543 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-92cb1d20-e3fd-4494-8b8f-fdcaa014a05f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:39.632404 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-92cb1d20-e3fd-4494-8b8f-fdcaa014a05f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1751 microversion: 2.20 time: 0.225602 Aug 26 15:57:39.633230 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 438/881] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:39 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1751 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:40.656216 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-ed3888f6-c407-4cde-a321-e1218bc0a94c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:40.656815 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ed3888f6-c407-4cde-a321-e1218bc0a94c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:40.664153 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ed3888f6-c407-4cde-a321-e1218bc0a94c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:40.669766 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ed3888f6-c407-4cde-a321-e1218bc0a94c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:40.669766 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ed3888f6-c407-4cde-a321-e1218bc0a94c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:40.669766 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ed3888f6-c407-4cde-a321-e1218bc0a94c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:40.669766 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ed3888f6-c407-4cde-a321-e1218bc0a94c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:40.670151 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ed3888f6-c407-4cde-a321-e1218bc0a94c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:40.804588 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ed3888f6-c407-4cde-a321-e1218bc0a94c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:40.813495 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ed3888f6-c407-4cde-a321-e1218bc0a94c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:40.815009 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ed3888f6-c407-4cde-a321-e1218bc0a94c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:40.816182 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-ed3888f6-c407-4cde-a321-e1218bc0a94c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1753 microversion: 2.20 time: 0.164155 Aug 26 15:57:40.816734 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 444/882] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:40 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:41.840453 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f700d40d-da31-40a5-93ac-6bb253b9f04f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:41.841099 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f700d40d-da31-40a5-93ac-6bb253b9f04f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:41.847803 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f700d40d-da31-40a5-93ac-6bb253b9f04f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:41.848322 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f700d40d-da31-40a5-93ac-6bb253b9f04f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:41.848813 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f700d40d-da31-40a5-93ac-6bb253b9f04f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:41.854437 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f700d40d-da31-40a5-93ac-6bb253b9f04f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:41.854437 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f700d40d-da31-40a5-93ac-6bb253b9f04f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:41.854437 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f700d40d-da31-40a5-93ac-6bb253b9f04f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:41.982729 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f700d40d-da31-40a5-93ac-6bb253b9f04f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:41.991959 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f700d40d-da31-40a5-93ac-6bb253b9f04f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:41.993405 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f700d40d-da31-40a5-93ac-6bb253b9f04f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:41.994561 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f700d40d-da31-40a5-93ac-6bb253b9f04f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1753 microversion: 2.20 time: 0.158626 Aug 26 15:57:41.997042 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 439/883] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:41 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:43.018426 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d28536d8-8e41-4fcb-b94f-15f0ade64066 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:43.019268 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d28536d8-8e41-4fcb-b94f-15f0ade64066 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:43.026105 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d28536d8-8e41-4fcb-b94f-15f0ade64066 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:43.026596 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d28536d8-8e41-4fcb-b94f-15f0ade64066 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:43.035229 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d28536d8-8e41-4fcb-b94f-15f0ade64066 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:43.035229 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d28536d8-8e41-4fcb-b94f-15f0ade64066 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:43.035229 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d28536d8-8e41-4fcb-b94f-15f0ade64066 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:43.035229 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d28536d8-8e41-4fcb-b94f-15f0ade64066 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:43.163648 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d28536d8-8e41-4fcb-b94f-15f0ade64066 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:43.173064 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d28536d8-8e41-4fcb-b94f-15f0ade64066 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:43.174512 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d28536d8-8e41-4fcb-b94f-15f0ade64066 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:43.175705 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d28536d8-8e41-4fcb-b94f-15f0ade64066 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.161241 Aug 26 15:57:43.177001 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 445/884] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:43 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:44.199026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ed839d94-da0d-433d-a5d2-9e785c2446e8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:44.199626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ed839d94-da0d-433d-a5d2-9e785c2446e8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:44.206544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed839d94-da0d-433d-a5d2-9e785c2446e8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:44.207028 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed839d94-da0d-433d-a5d2-9e785c2446e8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:44.207510 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed839d94-da0d-433d-a5d2-9e785c2446e8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:44.208855 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed839d94-da0d-433d-a5d2-9e785c2446e8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:44.209313 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed839d94-da0d-433d-a5d2-9e785c2446e8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:44.209744 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ed839d94-da0d-433d-a5d2-9e785c2446e8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:44.347845 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ed839d94-da0d-433d-a5d2-9e785c2446e8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:44.361908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ed839d94-da0d-433d-a5d2-9e785c2446e8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:44.363383 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ed839d94-da0d-433d-a5d2-9e785c2446e8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:44.365665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ed839d94-da0d-433d-a5d2-9e785c2446e8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.170486 Aug 26 15:57:44.367404 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 440/885] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:44 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:45.390833 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-8990022d-e296-45c1-b820-7936d7166e34 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:45.391515 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-8990022d-e296-45c1-b820-7936d7166e34 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:45.398088 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8990022d-e296-45c1-b820-7936d7166e34 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:45.398589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8990022d-e296-45c1-b820-7936d7166e34 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:45.399026 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8990022d-e296-45c1-b820-7936d7166e34 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:45.399721 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8990022d-e296-45c1-b820-7936d7166e34 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:45.400231 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8990022d-e296-45c1-b820-7936d7166e34 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:45.400657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8990022d-e296-45c1-b820-7936d7166e34 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:45.547748 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-8990022d-e296-45c1-b820-7936d7166e34 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:45.557080 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-8990022d-e296-45c1-b820-7936d7166e34 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:45.558514 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-8990022d-e296-45c1-b820-7936d7166e34 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:45.559702 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-8990022d-e296-45c1-b820-7936d7166e34 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.173369 Aug 26 15:57:45.560309 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 446/886] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:45 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:46.584542 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-12287630-1638-4149-9fe2-aaf2943b4135 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:46.585838 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-12287630-1638-4149-9fe2-aaf2943b4135 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:46.594175 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-12287630-1638-4149-9fe2-aaf2943b4135 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:46.594723 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-12287630-1638-4149-9fe2-aaf2943b4135 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:46.595211 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-12287630-1638-4149-9fe2-aaf2943b4135 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:46.596007 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-12287630-1638-4149-9fe2-aaf2943b4135 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:46.596461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-12287630-1638-4149-9fe2-aaf2943b4135 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:46.596886 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-12287630-1638-4149-9fe2-aaf2943b4135 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:46.753256 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-12287630-1638-4149-9fe2-aaf2943b4135 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:46.763605 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-12287630-1638-4149-9fe2-aaf2943b4135 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:46.765406 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-12287630-1638-4149-9fe2-aaf2943b4135 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:46.766741 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-12287630-1638-4149-9fe2-aaf2943b4135 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.187347 Aug 26 15:57:46.767351 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 441/887] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:46 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:47.791497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-71e59769-7afc-40d8-987d-5e8b01fbb3cc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:47.792488 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-71e59769-7afc-40d8-987d-5e8b01fbb3cc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:47.800751 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-71e59769-7afc-40d8-987d-5e8b01fbb3cc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:47.801908 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-71e59769-7afc-40d8-987d-5e8b01fbb3cc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:47.802303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-71e59769-7afc-40d8-987d-5e8b01fbb3cc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:47.803264 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-71e59769-7afc-40d8-987d-5e8b01fbb3cc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:47.803583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-71e59769-7afc-40d8-987d-5e8b01fbb3cc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:47.803961 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-71e59769-7afc-40d8-987d-5e8b01fbb3cc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:47.954027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-71e59769-7afc-40d8-987d-5e8b01fbb3cc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:47.963677 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-71e59769-7afc-40d8-987d-5e8b01fbb3cc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:47.965194 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-71e59769-7afc-40d8-987d-5e8b01fbb3cc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:47.966358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-71e59769-7afc-40d8-987d-5e8b01fbb3cc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.179351 Aug 26 15:57:47.966910 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 447/888] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:47 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:57:48.991121 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2b412add-4d1c-4c1a-b8e0-c5f15c4c0b09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:48.991788 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2b412add-4d1c-4c1a-b8e0-c5f15c4c0b09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:48.998540 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2b412add-4d1c-4c1a-b8e0-c5f15c4c0b09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:48.999023 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2b412add-4d1c-4c1a-b8e0-c5f15c4c0b09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:48.999464 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2b412add-4d1c-4c1a-b8e0-c5f15c4c0b09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:49.000226 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2b412add-4d1c-4c1a-b8e0-c5f15c4c0b09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:49.000766 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2b412add-4d1c-4c1a-b8e0-c5f15c4c0b09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:49.001191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2b412add-4d1c-4c1a-b8e0-c5f15c4c0b09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:49.171500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2b412add-4d1c-4c1a-b8e0-c5f15c4c0b09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:49.188600 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2b412add-4d1c-4c1a-b8e0-c5f15c4c0b09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:49.191215 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2b412add-4d1c-4c1a-b8e0-c5f15c4c0b09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:49.193313 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2b412add-4d1c-4c1a-b8e0-c5f15c4c0b09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.206457 Aug 26 15:57:49.194272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 442/889] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:48 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:50.230860 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c0556b99-1368-450a-9cd7-49bb09a4dedd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:50.231625 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c0556b99-1368-450a-9cd7-49bb09a4dedd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:50.239147 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c0556b99-1368-450a-9cd7-49bb09a4dedd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:50.239637 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c0556b99-1368-450a-9cd7-49bb09a4dedd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:50.240785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c0556b99-1368-450a-9cd7-49bb09a4dedd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:50.241498 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c0556b99-1368-450a-9cd7-49bb09a4dedd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:50.242014 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c0556b99-1368-450a-9cd7-49bb09a4dedd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:50.242441 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c0556b99-1368-450a-9cd7-49bb09a4dedd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:50.245479 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:50.392396 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c0556b99-1368-450a-9cd7-49bb09a4dedd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:50.402599 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c0556b99-1368-450a-9cd7-49bb09a4dedd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:50.404220 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c0556b99-1368-450a-9cd7-49bb09a4dedd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:50.405441 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c0556b99-1368-450a-9cd7-49bb09a4dedd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.178711 Aug 26 15:57:50.406320 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 448/890] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:50 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:51.429650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-bb80a26c-526e-4c45-b5d5-18c4c1f7337d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:51.430297 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-bb80a26c-526e-4c45-b5d5-18c4c1f7337d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:51.437877 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bb80a26c-526e-4c45-b5d5-18c4c1f7337d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:51.438374 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bb80a26c-526e-4c45-b5d5-18c4c1f7337d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:51.438803 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bb80a26c-526e-4c45-b5d5-18c4c1f7337d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:51.439504 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bb80a26c-526e-4c45-b5d5-18c4c1f7337d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:51.439984 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bb80a26c-526e-4c45-b5d5-18c4c1f7337d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:51.440408 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bb80a26c-526e-4c45-b5d5-18c4c1f7337d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:51.604508 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-bb80a26c-526e-4c45-b5d5-18c4c1f7337d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:51.613559 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-bb80a26c-526e-4c45-b5d5-18c4c1f7337d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:51.615043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-bb80a26c-526e-4c45-b5d5-18c4c1f7337d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:51.616245 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-bb80a26c-526e-4c45-b5d5-18c4c1f7337d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.191054 Aug 26 15:57:51.616799 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 443/891] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:51 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:52.640431 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6a08aeed-0cca-416c-b42c-dd1bfa42f071 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:52.641092 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6a08aeed-0cca-416c-b42c-dd1bfa42f071 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:52.648059 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6a08aeed-0cca-416c-b42c-dd1bfa42f071 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:52.648541 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6a08aeed-0cca-416c-b42c-dd1bfa42f071 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:52.648972 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6a08aeed-0cca-416c-b42c-dd1bfa42f071 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:52.649727 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6a08aeed-0cca-416c-b42c-dd1bfa42f071 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:52.650146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6a08aeed-0cca-416c-b42c-dd1bfa42f071 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:52.650541 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6a08aeed-0cca-416c-b42c-dd1bfa42f071 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:52.793956 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6a08aeed-0cca-416c-b42c-dd1bfa42f071 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:52.803529 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6a08aeed-0cca-416c-b42c-dd1bfa42f071 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:52.805054 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6a08aeed-0cca-416c-b42c-dd1bfa42f071 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:52.806238 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6a08aeed-0cca-416c-b42c-dd1bfa42f071 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.169721 Aug 26 15:57:52.806805 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 449/892] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:52 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:53.830118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d70db298-ec35-4a96-8246-2efd46b371b9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:53.830743 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d70db298-ec35-4a96-8246-2efd46b371b9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:53.833192 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:53.838387 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d70db298-ec35-4a96-8246-2efd46b371b9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:53.845267 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d70db298-ec35-4a96-8246-2efd46b371b9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:53.845267 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d70db298-ec35-4a96-8246-2efd46b371b9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:53.845267 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d70db298-ec35-4a96-8246-2efd46b371b9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:53.845267 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d70db298-ec35-4a96-8246-2efd46b371b9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:53.845683 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d70db298-ec35-4a96-8246-2efd46b371b9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:53.980796 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d70db298-ec35-4a96-8246-2efd46b371b9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:53.989954 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d70db298-ec35-4a96-8246-2efd46b371b9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:53.991386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d70db298-ec35-4a96-8246-2efd46b371b9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:53.992579 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d70db298-ec35-4a96-8246-2efd46b371b9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.166798 Aug 26 15:57:53.993148 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 444/893] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:53 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:54.199265 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-23de4aab-3a88-4482-8058-28923123af94 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:54.199841 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-23de4aab-3a88-4482-8058-28923123af94 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:54.206495 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-23de4aab-3a88-4482-8058-28923123af94 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:54.206975 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-23de4aab-3a88-4482-8058-28923123af94 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:54.207398 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-23de4aab-3a88-4482-8058-28923123af94 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:54.208121 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-23de4aab-3a88-4482-8058-28923123af94 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:54.208549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-23de4aab-3a88-4482-8058-28923123af94 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:54.208963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-23de4aab-3a88-4482-8058-28923123af94 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:54.231949 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-23de4aab-3a88-4482-8058-28923123af94 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/ips" status: 200 len: 149 microversion: 2.1 time: 0.036545 Aug 26 15:57:54.232518 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 450/894] 10.222.0.98 () {58 vars in 1248 bytes} [Fri Aug 26 15:57:54 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:55.016292 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1bd0473e-d1a5-4e5a-9b9a-d977850a09b3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:55.017014 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-1bd0473e-d1a5-4e5a-9b9a-d977850a09b3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:55.024383 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1bd0473e-d1a5-4e5a-9b9a-d977850a09b3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:55.024868 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1bd0473e-d1a5-4e5a-9b9a-d977850a09b3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:55.025306 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1bd0473e-d1a5-4e5a-9b9a-d977850a09b3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:55.025988 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1bd0473e-d1a5-4e5a-9b9a-d977850a09b3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:55.026452 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1bd0473e-d1a5-4e5a-9b9a-d977850a09b3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:55.026873 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1bd0473e-d1a5-4e5a-9b9a-d977850a09b3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:55.156879 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1bd0473e-d1a5-4e5a-9b9a-d977850a09b3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:55.166113 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1bd0473e-d1a5-4e5a-9b9a-d977850a09b3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:55.167542 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1bd0473e-d1a5-4e5a-9b9a-d977850a09b3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:55.168721 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-1bd0473e-d1a5-4e5a-9b9a-d977850a09b3 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.156504 Aug 26 15:57:55.173955 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 445/895] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:55 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:55.902108 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-abcd749e-83e6-4b7c-ab0c-5763213f2062 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81c5b28a-ee63-4828-8444-4f2ed51d44e4"}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:55.904603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-abcd749e-83e6-4b7c-ab0c-5763213f2062 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:55.911742 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-abcd749e-83e6-4b7c-ab0c-5763213f2062 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:55.912278 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-abcd749e-83e6-4b7c-ab0c-5763213f2062 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:55.912720 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-abcd749e-83e6-4b7c-ab0c-5763213f2062 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:55.913423 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-abcd749e-83e6-4b7c-ab0c-5763213f2062 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:55.913881 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-abcd749e-83e6-4b7c-ab0c-5763213f2062 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:55.914311 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-abcd749e-83e6-4b7c-ab0c-5763213f2062 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:56.192369 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c134baca-4ad4-42f0-ab35-2ca0291cec7c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:56.192961 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c134baca-4ad4-42f0-ab35-2ca0291cec7c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:56.200012 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c134baca-4ad4-42f0-ab35-2ca0291cec7c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:56.200489 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c134baca-4ad4-42f0-ab35-2ca0291cec7c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:56.200923 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c134baca-4ad4-42f0-ab35-2ca0291cec7c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:56.201866 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c134baca-4ad4-42f0-ab35-2ca0291cec7c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:56.202308 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c134baca-4ad4-42f0-ab35-2ca0291cec7c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:56.202723 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c134baca-4ad4-42f0-ab35-2ca0291cec7c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:56.336885 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c134baca-4ad4-42f0-ab35-2ca0291cec7c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:56.345606 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c134baca-4ad4-42f0-ab35-2ca0291cec7c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:56.347791 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c134baca-4ad4-42f0-ab35-2ca0291cec7c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:56.348969 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c134baca-4ad4-42f0-ab35-2ca0291cec7c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.160764 Aug 26 15:57:56.349530 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 446/896] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:56 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:57:56.745584 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-abcd749e-83e6-4b7c-ab0c-5763213f2062 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "POST /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.847355 Aug 26 15:57:56.746195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 451/897] 10.222.0.98 () {60 vars in 1323 bytes} [Fri Aug 26 15:57:55 2022] POST /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/os-volume_attachments => generated 194 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:57.372414 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2b956cc9-85a1-4553-a60e-eebb2365a3f4 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:57.372974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2b956cc9-85a1-4553-a60e-eebb2365a3f4 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:57.379572 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2b956cc9-85a1-4553-a60e-eebb2365a3f4 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:57.380093 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2b956cc9-85a1-4553-a60e-eebb2365a3f4 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:57.380532 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2b956cc9-85a1-4553-a60e-eebb2365a3f4 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:57.381228 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2b956cc9-85a1-4553-a60e-eebb2365a3f4 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:57.381685 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2b956cc9-85a1-4553-a60e-eebb2365a3f4 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:57.382112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2b956cc9-85a1-4553-a60e-eebb2365a3f4 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:57.513117 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2b956cc9-85a1-4553-a60e-eebb2365a3f4 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:57.521809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2b956cc9-85a1-4553-a60e-eebb2365a3f4 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:57.523255 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2b956cc9-85a1-4553-a60e-eebb2365a3f4 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:57.524454 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2b956cc9-85a1-4553-a60e-eebb2365a3f4 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.156070 Aug 26 15:57:57.525009 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 447/898] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:57 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:58.547842 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-42148408-fe42-46d3-bee8-5a058f5825d9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:58.548563 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-42148408-fe42-46d3-bee8-5a058f5825d9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:58.556258 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-42148408-fe42-46d3-bee8-5a058f5825d9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:58.556738 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-42148408-fe42-46d3-bee8-5a058f5825d9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:58.557165 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-42148408-fe42-46d3-bee8-5a058f5825d9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:58.558478 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-42148408-fe42-46d3-bee8-5a058f5825d9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:58.558935 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-42148408-fe42-46d3-bee8-5a058f5825d9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:58.559343 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-42148408-fe42-46d3-bee8-5a058f5825d9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:58.698007 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-42148408-fe42-46d3-bee8-5a058f5825d9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:58.707629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-42148408-fe42-46d3-bee8-5a058f5825d9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:58.709101 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-42148408-fe42-46d3-bee8-5a058f5825d9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:58.710427 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-42148408-fe42-46d3-bee8-5a058f5825d9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.167383 Aug 26 15:57:58.711005 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 452/899] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:58 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:59.733323 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f874c839-5394-4c7f-b37c-9aa56688e78b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:59.733944 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f874c839-5394-4c7f-b37c-9aa56688e78b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:59.740977 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f874c839-5394-4c7f-b37c-9aa56688e78b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:59.741459 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f874c839-5394-4c7f-b37c-9aa56688e78b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:59.741898 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f874c839-5394-4c7f-b37c-9aa56688e78b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:59.742589 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f874c839-5394-4c7f-b37c-9aa56688e78b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:59.743040 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f874c839-5394-4c7f-b37c-9aa56688e78b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:59.743467 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f874c839-5394-4c7f-b37c-9aa56688e78b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:59.870137 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f874c839-5394-4c7f-b37c-9aa56688e78b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:59.879323 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f874c839-5394-4c7f-b37c-9aa56688e78b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:59.880792 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f874c839-5394-4c7f-b37c-9aa56688e78b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:59.881941 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f874c839-5394-4c7f-b37c-9aa56688e78b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.152621 Aug 26 15:57:59.882495 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 448/900] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:59 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:58:00.904964 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-bb7365fe-ec60-4176-8279-20999328077a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:00.905517 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-bb7365fe-ec60-4176-8279-20999328077a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:00.912668 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bb7365fe-ec60-4176-8279-20999328077a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:00.913154 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bb7365fe-ec60-4176-8279-20999328077a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:00.913590 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bb7365fe-ec60-4176-8279-20999328077a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:00.914296 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bb7365fe-ec60-4176-8279-20999328077a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:00.914742 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bb7365fe-ec60-4176-8279-20999328077a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:00.915163 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bb7365fe-ec60-4176-8279-20999328077a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:01.047281 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-bb7365fe-ec60-4176-8279-20999328077a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:01.056536 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-bb7365fe-ec60-4176-8279-20999328077a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:01.057948 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-bb7365fe-ec60-4176-8279-20999328077a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:01.059092 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-bb7365fe-ec60-4176-8279-20999328077a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.158141 Aug 26 15:58:01.059642 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 453/901] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:00 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:58:02.083405 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-233622f5-2b30-4457-9263-6d0e9f648cba tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:02.087399 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-233622f5-2b30-4457-9263-6d0e9f648cba tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:02.090677 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-233622f5-2b30-4457-9263-6d0e9f648cba tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:02.091157 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-233622f5-2b30-4457-9263-6d0e9f648cba tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:02.091583 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-233622f5-2b30-4457-9263-6d0e9f648cba tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:02.092331 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-233622f5-2b30-4457-9263-6d0e9f648cba tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:02.092778 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-233622f5-2b30-4457-9263-6d0e9f648cba tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:02.093195 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-233622f5-2b30-4457-9263-6d0e9f648cba tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:02.225777 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-233622f5-2b30-4457-9263-6d0e9f648cba tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:02.234301 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-233622f5-2b30-4457-9263-6d0e9f648cba tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:02.235735 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-233622f5-2b30-4457-9263-6d0e9f648cba tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:02.236910 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-233622f5-2b30-4457-9263-6d0e9f648cba tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.158043 Aug 26 15:58:02.237524 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 449/902] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:02 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:58:03.259834 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7bf2116c-4b9b-4396-b52d-63c8101f71fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:03.260475 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7bf2116c-4b9b-4396-b52d-63c8101f71fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:03.267027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7bf2116c-4b9b-4396-b52d-63c8101f71fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:03.267511 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7bf2116c-4b9b-4396-b52d-63c8101f71fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:03.267982 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7bf2116c-4b9b-4396-b52d-63c8101f71fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:03.268684 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7bf2116c-4b9b-4396-b52d-63c8101f71fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:03.269135 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7bf2116c-4b9b-4396-b52d-63c8101f71fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:03.269568 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7bf2116c-4b9b-4396-b52d-63c8101f71fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:03.411808 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7bf2116c-4b9b-4396-b52d-63c8101f71fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:03.421562 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7bf2116c-4b9b-4396-b52d-63c8101f71fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:03.423225 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7bf2116c-4b9b-4396-b52d-63c8101f71fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:03.424491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7bf2116c-4b9b-4396-b52d-63c8101f71fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.168565 Aug 26 15:58:03.425187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 454/903] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:03 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:58:03.738302 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-cfe9776d-bd25-43ea-bb6f-71e84260a70a req-86e0e774-2182-43f5-bcc5-87f8f0f8356f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6825d4-cc4d-4688-9532-01a6cee66ea2", "name": "network-vif-plugged", "status": "completed", "tag": "57bf8f97-285e-4041-93e6-6c458f946244"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:03.748481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-cfe9776d-bd25-43ea-bb6f-71e84260a70a req-86e0e774-2182-43f5-bcc5-87f8f0f8356f service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:03.748966 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-cfe9776d-bd25-43ea-bb6f-71e84260a70a req-86e0e774-2182-43f5-bcc5-87f8f0f8356f service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:03.749394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-cfe9776d-bd25-43ea-bb6f-71e84260a70a req-86e0e774-2182-43f5-bcc5-87f8f0f8356f service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:03.760939 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-cfe9776d-bd25-43ea-bb6f-71e84260a70a req-86e0e774-2182-43f5-bcc5-87f8f0f8356f service nova] Creating event network-vif-plugged:57bf8f97-285e-4041-93e6-6c458f946244 for instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 on hv-cinder-83124 Aug 26 15:58:03.766944 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-cfe9776d-bd25-43ea-bb6f-71e84260a70a req-86e0e774-2182-43f5-bcc5-87f8f0f8356f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032917 Aug 26 15:58:03.767552 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 450/904] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:04.411396 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-bdbd51e9-ad07-42c4-bde8-9b88b08da971 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:04.411995 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-bdbd51e9-ad07-42c4-bde8-9b88b08da971 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:04.418590 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bdbd51e9-ad07-42c4-bde8-9b88b08da971 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:04.419060 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bdbd51e9-ad07-42c4-bde8-9b88b08da971 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:04.419487 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bdbd51e9-ad07-42c4-bde8-9b88b08da971 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:04.420216 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bdbd51e9-ad07-42c4-bde8-9b88b08da971 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:04.420662 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bdbd51e9-ad07-42c4-bde8-9b88b08da971 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:04.425130 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bdbd51e9-ad07-42c4-bde8-9b88b08da971 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:04.449769 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5d3a0cc5-5fab-47fb-a64f-4aea52155d67 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:04.450471 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5d3a0cc5-5fab-47fb-a64f-4aea52155d67 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:04.459580 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5d3a0cc5-5fab-47fb-a64f-4aea52155d67 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:04.460181 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5d3a0cc5-5fab-47fb-a64f-4aea52155d67 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:04.460613 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5d3a0cc5-5fab-47fb-a64f-4aea52155d67 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:04.465060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5d3a0cc5-5fab-47fb-a64f-4aea52155d67 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:04.465060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5d3a0cc5-5fab-47fb-a64f-4aea52155d67 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:04.465060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5d3a0cc5-5fab-47fb-a64f-4aea52155d67 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:04.507399 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-bdbd51e9-ad07-42c4-bde8-9b88b08da971 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lazy-loading 'services' on Instance uuid 328fd5f1-9e47-43b3-aea0-a3246130ff2c {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:58:04.661844 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-5d3a0cc5-5fab-47fb-a64f-4aea52155d67 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:04.672340 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-5d3a0cc5-5fab-47fb-a64f-4aea52155d67 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:04.675514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-5d3a0cc5-5fab-47fb-a64f-4aea52155d67 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:04.677934 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5d3a0cc5-5fab-47fb-a64f-4aea52155d67 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.231065 Aug 26 15:58:04.678612 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 451/905] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:04 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:58:04.770493 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-bdbd51e9-ad07-42c4-bde8-9b88b08da971 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "DELETE /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/os-volume_attachments/81c5b28a-ee63-4828-8444-4f2ed51d44e4" status: 202 len: 0 microversion: 2.1 time: 0.363268 Aug 26 15:58:04.771117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 455/906] 10.222.0.98 () {58 vars in 1416 bytes} [Fri Aug 26 15:58:04 2022] DELETE /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/os-volume_attachments/81c5b28a-ee63-4828-8444-4f2ed51d44e4 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:58:04.780259 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a545e76c-5c65-4925-8c82-d96354bf3d34 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:04.782543 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a545e76c-5c65-4925-8c82-d96354bf3d34 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:04.790357 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a545e76c-5c65-4925-8c82-d96354bf3d34 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:04.790849 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a545e76c-5c65-4925-8c82-d96354bf3d34 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:04.791288 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a545e76c-5c65-4925-8c82-d96354bf3d34 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:04.792060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a545e76c-5c65-4925-8c82-d96354bf3d34 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:04.792522 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a545e76c-5c65-4925-8c82-d96354bf3d34 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:04.792944 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a545e76c-5c65-4925-8c82-d96354bf3d34 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:04.828695 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-a545e76c-5c65-4925-8c82-d96354bf3d34 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052670 Aug 26 15:58:04.829280 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 452/907] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:58:04 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:05.702947 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e9d64f84-8d2a-47bd-af3b-34b0e968b102 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:05.703646 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e9d64f84-8d2a-47bd-af3b-34b0e968b102 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:05.705747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=32 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:05.711389 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e9d64f84-8d2a-47bd-af3b-34b0e968b102 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:05.711904 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e9d64f84-8d2a-47bd-af3b-34b0e968b102 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:05.717053 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e9d64f84-8d2a-47bd-af3b-34b0e968b102 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:05.717053 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e9d64f84-8d2a-47bd-af3b-34b0e968b102 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:05.717053 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e9d64f84-8d2a-47bd-af3b-34b0e968b102 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:05.717053 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e9d64f84-8d2a-47bd-af3b-34b0e968b102 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:05.844221 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c63e2e6a-79e2-42a0-9eec-e8efa9c9e3de tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:05.847668 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c63e2e6a-79e2-42a0-9eec-e8efa9c9e3de tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:05.859482 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c63e2e6a-79e2-42a0-9eec-e8efa9c9e3de tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:05.860329 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c63e2e6a-79e2-42a0-9eec-e8efa9c9e3de tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:05.861582 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c63e2e6a-79e2-42a0-9eec-e8efa9c9e3de tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:05.863324 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c63e2e6a-79e2-42a0-9eec-e8efa9c9e3de tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:05.864332 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c63e2e6a-79e2-42a0-9eec-e8efa9c9e3de tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:05.866546 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c63e2e6a-79e2-42a0-9eec-e8efa9c9e3de tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:05.895781 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e9d64f84-8d2a-47bd-af3b-34b0e968b102 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:05.911327 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e9d64f84-8d2a-47bd-af3b-34b0e968b102 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:05.914765 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-e9d64f84-8d2a-47bd-af3b-34b0e968b102 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:05.917069 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e9d64f84-8d2a-47bd-af3b-34b0e968b102 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.218775 Aug 26 15:58:05.918549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 456/908] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:05 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:58:05.938126 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c63e2e6a-79e2-42a0-9eec-e8efa9c9e3de tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098605 Aug 26 15:58:05.946810 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 453/909] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:58:05 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:58:06.955562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-480e5b3d-9789-4034-9dc2-1fb8a2c1c27a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:06.956599 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-480e5b3d-9789-4034-9dc2-1fb8a2c1c27a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:06.957263 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b9ec4a5c-268f-4978-8437-f1f2beece015 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:06.961775 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b9ec4a5c-268f-4978-8437-f1f2beece015 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:06.967113 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-480e5b3d-9789-4034-9dc2-1fb8a2c1c27a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:06.968856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-480e5b3d-9789-4034-9dc2-1fb8a2c1c27a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:06.968856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-480e5b3d-9789-4034-9dc2-1fb8a2c1c27a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:06.969420 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-480e5b3d-9789-4034-9dc2-1fb8a2c1c27a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:06.970073 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-480e5b3d-9789-4034-9dc2-1fb8a2c1c27a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:06.970779 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-480e5b3d-9789-4034-9dc2-1fb8a2c1c27a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:06.976305 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9ec4a5c-268f-4978-8437-f1f2beece015 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:06.977404 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9ec4a5c-268f-4978-8437-f1f2beece015 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:06.978800 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9ec4a5c-268f-4978-8437-f1f2beece015 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:06.980324 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9ec4a5c-268f-4978-8437-f1f2beece015 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:06.981372 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9ec4a5c-268f-4978-8437-f1f2beece015 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:06.982325 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b9ec4a5c-268f-4978-8437-f1f2beece015 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:07.035618 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b9ec4a5c-268f-4978-8437-f1f2beece015 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084000 Aug 26 15:58:07.036644 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 457/910] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:58:06 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:58:07.165443 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-480e5b3d-9789-4034-9dc2-1fb8a2c1c27a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:07.181522 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-480e5b3d-9789-4034-9dc2-1fb8a2c1c27a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:07.184478 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-480e5b3d-9789-4034-9dc2-1fb8a2c1c27a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:07.186749 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-480e5b3d-9789-4034-9dc2-1fb8a2c1c27a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1809 microversion: 2.20 time: 0.234808 Aug 26 15:58:07.187906 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 454/911] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:06 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:58:08.056020 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-95cf0e5e-28b3-46b8-8304-ba84564e4cf9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:08.059710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-95cf0e5e-28b3-46b8-8304-ba84564e4cf9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:08.071630 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-95cf0e5e-28b3-46b8-8304-ba84564e4cf9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:08.072530 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-95cf0e5e-28b3-46b8-8304-ba84564e4cf9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:08.073301 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-95cf0e5e-28b3-46b8-8304-ba84564e4cf9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:08.074536 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-95cf0e5e-28b3-46b8-8304-ba84564e4cf9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:08.075349 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-95cf0e5e-28b3-46b8-8304-ba84564e4cf9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:08.076407 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-95cf0e5e-28b3-46b8-8304-ba84564e4cf9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:08.134606 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-95cf0e5e-28b3-46b8-8304-ba84564e4cf9 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086662 Aug 26 15:58:08.135668 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 458/912] 10.222.0.98 () {58 vars in 1302 bytes} [Fri Aug 26 15:58:08 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 15:58:08.213114 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6cdc5f44-0dad-4ba5-b349-9950d0a5c674 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:08.213829 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6cdc5f44-0dad-4ba5-b349-9950d0a5c674 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:08.216164 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e3003f10-fe18-4c19-8c23-0ece12043c99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:08.217060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e3003f10-fe18-4c19-8c23-0ece12043c99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:08.220301 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6cdc5f44-0dad-4ba5-b349-9950d0a5c674 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:08.220787 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6cdc5f44-0dad-4ba5-b349-9950d0a5c674 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:08.221883 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6cdc5f44-0dad-4ba5-b349-9950d0a5c674 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:08.222439 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6cdc5f44-0dad-4ba5-b349-9950d0a5c674 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:08.222892 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6cdc5f44-0dad-4ba5-b349-9950d0a5c674 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:08.223316 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6cdc5f44-0dad-4ba5-b349-9950d0a5c674 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:08.228732 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e3003f10-fe18-4c19-8c23-0ece12043c99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:08.229300 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e3003f10-fe18-4c19-8c23-0ece12043c99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:08.230041 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e3003f10-fe18-4c19-8c23-0ece12043c99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:08.231269 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e3003f10-fe18-4c19-8c23-0ece12043c99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:08.232081 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e3003f10-fe18-4c19-8c23-0ece12043c99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:08.232839 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e3003f10-fe18-4c19-8c23-0ece12043c99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:08.281591 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=100 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:08.300591 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e3003f10-fe18-4c19-8c23-0ece12043c99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Going to try to terminate instance {{(pid=127698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:58:08.392665 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6cdc5f44-0dad-4ba5-b349-9950d0a5c674 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:08.402446 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6cdc5f44-0dad-4ba5-b349-9950d0a5c674 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:08.403913 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6cdc5f44-0dad-4ba5-b349-9950d0a5c674 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:08.405099 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6cdc5f44-0dad-4ba5-b349-9950d0a5c674 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1796 microversion: 2.20 time: 0.195955 Aug 26 15:58:08.405665 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 459/913] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:08 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1796 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:58:08.604674 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e3003f10-fe18-4c19-8c23-0ece12043c99 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "DELETE /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 204 len: 0 microversion: 2.1 time: 0.395027 Aug 26 15:58:08.605378 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 455/914] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:58:08 2022] DELETE /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:58:08.615901 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-790c3ad3-98c2-47ac-89de-5af414f7f07d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:08.616536 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-790c3ad3-98c2-47ac-89de-5af414f7f07d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:08.623581 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-790c3ad3-98c2-47ac-89de-5af414f7f07d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:08.624346 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-790c3ad3-98c2-47ac-89de-5af414f7f07d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:08.624952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-790c3ad3-98c2-47ac-89de-5af414f7f07d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:08.625996 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-790c3ad3-98c2-47ac-89de-5af414f7f07d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:08.626679 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-790c3ad3-98c2-47ac-89de-5af414f7f07d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:08.627467 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-790c3ad3-98c2-47ac-89de-5af414f7f07d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:08.828800 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-790c3ad3-98c2-47ac-89de-5af414f7f07d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:08.840682 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-790c3ad3-98c2-47ac-89de-5af414f7f07d tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1681 microversion: 2.1 time: 0.229076 Aug 26 15:58:08.841664 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 460/915] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:08 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:09.873828 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8df6466a-ebb6-4784-8f2f-6655b0ea31a5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:09.874433 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-8df6466a-ebb6-4784-8f2f-6655b0ea31a5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:09.881065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8df6466a-ebb6-4784-8f2f-6655b0ea31a5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:09.881546 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8df6466a-ebb6-4784-8f2f-6655b0ea31a5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:09.881976 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8df6466a-ebb6-4784-8f2f-6655b0ea31a5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:09.882668 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8df6466a-ebb6-4784-8f2f-6655b0ea31a5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:09.883113 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8df6466a-ebb6-4784-8f2f-6655b0ea31a5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:09.883530 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8df6466a-ebb6-4784-8f2f-6655b0ea31a5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:10.018482 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8df6466a-ebb6-4784-8f2f-6655b0ea31a5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:10.026485 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-8df6466a-ebb6-4784-8f2f-6655b0ea31a5 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1681 microversion: 2.1 time: 0.156975 Aug 26 15:58:10.027080 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 456/916] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:09 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:11.048257 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c42520b0-ecef-4db3-93b5-3aad14ffc893 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:11.048867 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c42520b0-ecef-4db3-93b5-3aad14ffc893 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:11.055957 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c42520b0-ecef-4db3-93b5-3aad14ffc893 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:11.056441 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c42520b0-ecef-4db3-93b5-3aad14ffc893 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:11.056873 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c42520b0-ecef-4db3-93b5-3aad14ffc893 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:11.057594 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c42520b0-ecef-4db3-93b5-3aad14ffc893 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:11.058044 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c42520b0-ecef-4db3-93b5-3aad14ffc893 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:11.058462 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c42520b0-ecef-4db3-93b5-3aad14ffc893 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:11.190087 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c42520b0-ecef-4db3-93b5-3aad14ffc893 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:11.197845 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c42520b0-ecef-4db3-93b5-3aad14ffc893 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1681 microversion: 2.1 time: 0.153397 Aug 26 15:58:11.198395 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 461/917] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:11 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:12.219434 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-cafccc0a-9a4e-4377-aede-517bc99d3619 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:12.220144 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-cafccc0a-9a4e-4377-aede-517bc99d3619 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:12.226795 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cafccc0a-9a4e-4377-aede-517bc99d3619 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:12.227276 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cafccc0a-9a4e-4377-aede-517bc99d3619 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:12.227720 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cafccc0a-9a4e-4377-aede-517bc99d3619 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:12.228476 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cafccc0a-9a4e-4377-aede-517bc99d3619 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:12.228928 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cafccc0a-9a4e-4377-aede-517bc99d3619 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:12.229353 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-cafccc0a-9a4e-4377-aede-517bc99d3619 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:12.363617 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-cafccc0a-9a4e-4377-aede-517bc99d3619 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:12.371688 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-cafccc0a-9a4e-4377-aede-517bc99d3619 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1681 microversion: 2.1 time: 0.156098 Aug 26 15:58:12.372308 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 457/918] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:12 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:13.394411 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6fc0c006-d761-4767-930a-72296789b443 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:13.394971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6fc0c006-d761-4767-930a-72296789b443 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:13.401492 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6fc0c006-d761-4767-930a-72296789b443 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:13.402093 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6fc0c006-d761-4767-930a-72296789b443 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:13.402532 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6fc0c006-d761-4767-930a-72296789b443 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:13.403265 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6fc0c006-d761-4767-930a-72296789b443 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:13.403717 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6fc0c006-d761-4767-930a-72296789b443 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:13.404177 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6fc0c006-d761-4767-930a-72296789b443 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:13.534483 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6fc0c006-d761-4767-930a-72296789b443 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:13.542444 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6fc0c006-d761-4767-930a-72296789b443 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1681 microversion: 2.1 time: 0.152682 Aug 26 15:58:13.543266 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 462/919] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:13 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:13.955789 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-a0d8503c-de8f-41f0-aa9e-e1da33dac666 req-3a531182-bf84-4ebb-a9c3-09dac6d0d4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328fd5f1-9e47-43b3-aea0-a3246130ff2c", "name": "network-vif-deleted", "tag": "b9879cfe-fc48-49ee-b340-611f099b4e9b"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:13.966815 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-a0d8503c-de8f-41f0-aa9e-e1da33dac666 req-3a531182-bf84-4ebb-a9c3-09dac6d0d4e6 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:13.967444 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-a0d8503c-de8f-41f0-aa9e-e1da33dac666 req-3a531182-bf84-4ebb-a9c3-09dac6d0d4e6 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:13.968017 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-a0d8503c-de8f-41f0-aa9e-e1da33dac666 req-3a531182-bf84-4ebb-a9c3-09dac6d0d4e6 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:13.981385 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-a0d8503c-de8f-41f0-aa9e-e1da33dac666 req-3a531182-bf84-4ebb-a9c3-09dac6d0d4e6 service nova] Creating event network-vif-deleted:b9879cfe-fc48-49ee-b340-611f099b4e9b for instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c on hv-cinder-83124 Aug 26 15:58:13.990893 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-a0d8503c-de8f-41f0-aa9e-e1da33dac666 req-3a531182-bf84-4ebb-a9c3-09dac6d0d4e6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034854 Aug 26 15:58:13.990893 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 458/920] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:14.563801 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d22274ff-d463-47b6-b29b-27c7e61ff418 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:14.564652 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d22274ff-d463-47b6-b29b-27c7e61ff418 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:14.571249 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d22274ff-d463-47b6-b29b-27c7e61ff418 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:14.571815 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d22274ff-d463-47b6-b29b-27c7e61ff418 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:14.572359 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d22274ff-d463-47b6-b29b-27c7e61ff418 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:14.573126 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d22274ff-d463-47b6-b29b-27c7e61ff418 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:14.573674 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d22274ff-d463-47b6-b29b-27c7e61ff418 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:14.574172 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d22274ff-d463-47b6-b29b-27c7e61ff418 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:14.577577 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:14.617948 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d22274ff-d463-47b6-b29b-27c7e61ff418 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:14.618300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d22274ff-d463-47b6-b29b-27c7e61ff418 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:14.618739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d22274ff-d463-47b6-b29b-27c7e61ff418 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:14.619188 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-d22274ff-d463-47b6-b29b-27c7e61ff418 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lazy-loading 'fault' on Instance uuid 328fd5f1-9e47-43b3-aea0-a3246130ff2c {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:58:14.667289 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d22274ff-d463-47b6-b29b-27c7e61ff418 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9348310fd06b473786d1c6be4f20c481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40d6476c750438c9c09107c7757fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:14.678113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d22274ff-d463-47b6-b29b-27c7e61ff418 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 200 len: 1331 microversion: 2.1 time: 0.118156 Aug 26 15:58:14.678699 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 463/921] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:14 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:15.701001 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-26beafa9-9f00-4c66-aab9-beff2d73e005 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:15.701723 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-26beafa9-9f00-4c66-aab9-beff2d73e005 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:15.709037 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-26beafa9-9f00-4c66-aab9-beff2d73e005 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:15.709509 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-26beafa9-9f00-4c66-aab9-beff2d73e005 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:15.709935 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-26beafa9-9f00-4c66-aab9-beff2d73e005 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:15.710622 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-26beafa9-9f00-4c66-aab9-beff2d73e005 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:15.711071 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-26beafa9-9f00-4c66-aab9-beff2d73e005 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:15.711487 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-26beafa9-9f00-4c66-aab9-beff2d73e005 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:15.725212 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-26beafa9-9f00-4c66-aab9-beff2d73e005 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] HTTP exception thrown: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-26beafa9-9f00-4c66-aab9-beff2d73e005 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Request method failure captured: Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c HTTP/1.1 Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOwce1DELhS8UmzpwnI-HX_EQrzE1_2dLaZIAb4DQQsaHzNq-4kKoCdv0aDJeKx2SvQqLHnYNV9XirCc5SAbojp-C1CHsa7OjA6o0rOrx5rLneplb_EX2pmB01iYBvFpO8o6110oFO2yAC5E6SvWdsfGmZrZ7TZSaR32s4VudVlpurQ Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:58:15.727809 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:58:15.729562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f40d6476c750438c9c09107c7757fa95", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}] Aug 26 15:58:15.729562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:15.729562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:15.729562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:15.729562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:15.729562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:58:15.729562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:58:15.729562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 9348310fd06b473786d1c6be4f20c481 Aug 26 15:58:15.729562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:15.729562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:58:15.729562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. Aug 26 15:58:15.729562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '328fd5f1-9e47-43b3-aea0-a3246130ff2c'} Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:15.730514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. Aug 26 15:58:15.732139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:15.733612 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-26beafa9-9f00-4c66-aab9-beff2d73e005 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Returning 404 to user: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:15.733612 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-26beafa9-9f00-4c66-aab9-beff2d73e005 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 404 len: 111 microversion: 2.1 time: 0.032671 Aug 26 15:58:15.733612 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 459/922] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:15 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:58:15.739800 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-468644d6-06d4-4bbc-b80c-57578a1bbd75 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '.version_select at 0x7fbd1e272940>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:15.838845 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-468644d6-06d4-4bbc-b80c-57578a1bbd75 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1796300171" status: 202 len: 0 microversion: 2.1 time: 0.103213 Aug 26 15:58:15.839445 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 464/923] 10.222.0.98 () {58 vars in 1221 bytes} [Fri Aug 26 15:58:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1796300171 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:58:17.604095 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-588824507", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-764795854", "security_groups": [{"name": "tempest-secgroup-smoke-605569295"}], "block_device_mapping_v2": [{"uuid": "ebfc88a2-85f0-4641-9c5e-9a81284b3644", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4908c59f-0bb1-43e0-b8ad-2ab3083c5d12"}]}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:17.735417 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.network.neutron [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] validate_networks() for [('4908c59f-0bb1-43e0-b8ad-2ab3083c5d12', None, None, None, None, None)] {{(pid=127698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:58:18.204945 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Flavor limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:58:18.205366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Image limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:58:18.205839 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Flavor pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:58:18.206253 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Image pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:58:18.206664 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:58:18.215622 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:18.216133 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:18.216576 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:18.217301 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:18.217765 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:18.218189 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:18.236800 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Getting quotas for project d19b01b0af6c43feb357799d8ae948e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:58:18.241077 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Getting quotas for user 436adf49f3e24e03971017ea6dd33ac8 and project d19b01b0af6c43feb357799d8ae948e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:58:18.288734 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-19966412-2739-4c45-a442-13ca561d6fa2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:18.289388 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-19966412-2739-4c45-a442-13ca561d6fa2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:18.296134 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-19966412-2739-4c45-a442-13ca561d6fa2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:18.296630 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-19966412-2739-4c45-a442-13ca561d6fa2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:18.297068 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-19966412-2739-4c45-a442-13ca561d6fa2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:18.297767 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-19966412-2739-4c45-a442-13ca561d6fa2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:18.298226 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-19966412-2739-4c45-a442-13ca561d6fa2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:18.299160 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-19966412-2739-4c45-a442-13ca561d6fa2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:18.313400 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-19966412-2739-4c45-a442-13ca561d6fa2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] HTTP exception thrown: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-19966412-2739-4c45-a442-13ca561d6fa2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Request method failure captured: Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: DELETE /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c HTTP/1.1 Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOwce1DELhS8UmzpwnI-HX_EQrzE1_2dLaZIAb4DQQsaHzNq-4kKoCdv0aDJeKx2SvQqLHnYNV9XirCc5SAbojp-C1CHsa7OjA6o0rOrx5rLneplb_EX2pmB01iYBvFpO8o6110oFO2yAC5E6SvWdsfGmZrZ7TZSaR32s4VudVlpurQ Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:58:18.315491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:58:18.318516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f40d6476c750438c9c09107c7757fa95", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}] Aug 26 15:58:18.318516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:18.318516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:18.318516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:18.318516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:18.318516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:58:18.318516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:58:18.318516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 9348310fd06b473786d1c6be4f20c481 Aug 26 15:58:18.318516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:18.318516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:58:18.318516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. Aug 26 15:58:18.318516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '328fd5f1-9e47-43b3-aea0-a3246130ff2c'} Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:18.320204 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. Aug 26 15:58:18.323116 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:18.326140 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-19966412-2739-4c45-a442-13ca561d6fa2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Returning 404 to user: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:18.326140 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-19966412-2739-4c45-a442-13ca561d6fa2 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "DELETE /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 404 len: 111 microversion: 2.1 time: 0.032189 Aug 26 15:58:18.326140 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 465/924] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:58:18 2022] DELETE /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 15:58:18.326576 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Going to run 1 instances... {{(pid=127698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:58:18.326777 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1113cba6-865c-4358-9d81-a469e1a3e711 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:18.326777 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1113cba6-865c-4358-9d81-a469e1a3e711 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 328fd5f1-9e47-43b3-aea0-a3246130ff2c] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:18.328586 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ebfc88a2-85f0-4641-9c5e-9a81284b3644',volume_size=None,volume_type=None)] {{(pid=127698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:58:18.335464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1113cba6-865c-4358-9d81-a469e1a3e711 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:18.336261 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1113cba6-865c-4358-9d81-a469e1a3e711 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:18.336992 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1113cba6-865c-4358-9d81-a469e1a3e711 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:18.337952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1113cba6-865c-4358-9d81-a469e1a3e711 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:18.338585 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1113cba6-865c-4358-9d81-a469e1a3e711 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:18.339022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1113cba6-865c-4358-9d81-a469e1a3e711 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:18.356145 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-1113cba6-865c-4358-9d81-a469e1a3e711 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] HTTP exception thrown: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1113cba6-865c-4358-9d81-a469e1a3e711 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Request method failure captured: Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c HTTP/1.1 Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOwce1DELhS8UmzpwnI-HX_EQrzE1_2dLaZIAb4DQQsaHzNq-4kKoCdv0aDJeKx2SvQqLHnYNV9XirCc5SAbojp-C1CHsa7OjA6o0rOrx5rLneplb_EX2pmB01iYBvFpO8o6110oFO2yAC5E6SvWdsfGmZrZ7TZSaR32s4VudVlpurQ Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:58:18.357811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:58:18.363347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f40d6476c750438c9c09107c7757fa95", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}] Aug 26 15:58:18.363347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:18.363347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:18.363347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:18.363347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:18.363347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:58:18.363347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:58:18.363347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 9348310fd06b473786d1c6be4f20c481 Aug 26 15:58:18.363347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:18.363347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:58:18.363347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. Aug 26 15:58:18.363347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '328fd5f1-9e47-43b3-aea0-a3246130ff2c'} Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:18.364569 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. Aug 26 15:58:18.366183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:18.367412 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1113cba6-865c-4358-9d81-a469e1a3e711 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Returning 404 to user: Instance 328fd5f1-9e47-43b3-aea0-a3246130ff2c could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:18.367412 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1113cba6-865c-4358-9d81-a469e1a3e711 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c" status: 404 len: 111 microversion: 2.1 time: 0.037444 Aug 26 15:58:18.367412 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 466/925] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:18 2022] GET /compute/v2.1/servers/328fd5f1-9e47-43b3-aea0-a3246130ff2c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:58:18.891583 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-95a12f37-33e7-4b18-becf-68c969495c3b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.291383 Aug 26 15:58:18.893774 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 460/926] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 15:58:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 15:58:18.906497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b5e73183-4cdf-4eb4-bbb8-8625949b9655 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:18.907118 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b5e73183-4cdf-4eb4-bbb8-8625949b9655 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:18.986924 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b5e73183-4cdf-4eb4-bbb8-8625949b9655 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:18.995267 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b5e73183-4cdf-4eb4-bbb8-8625949b9655 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1093 microversion: 2.1 time: 0.093294 Aug 26 15:58:18.996438 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 467/927] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:18 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1093 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:19.696013 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a062c73a-1d43-430d-a5a5-df60134b8fa8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:19.696764 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a062c73a-1d43-430d-a5a5-df60134b8fa8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:19.705743 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a062c73a-1d43-430d-a5a5-df60134b8fa8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:19.706238 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a062c73a-1d43-430d-a5a5-df60134b8fa8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:19.706680 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a062c73a-1d43-430d-a5a5-df60134b8fa8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:19.707565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a062c73a-1d43-430d-a5a5-df60134b8fa8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:19.708103 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a062c73a-1d43-430d-a5a5-df60134b8fa8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:19.708539 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a062c73a-1d43-430d-a5a5-df60134b8fa8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:19.724116 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-a062c73a-1d43-430d-a5a5-df60134b8fa8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] HTTP exception thrown: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a062c73a-1d43-430d-a5a5-df60134b8fa8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Request method failure captured: Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: DELETE /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 HTTP/1.1 Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOwce1DELhS8UmzpwnI-HX_EQrzE1_2dLaZIAb4DQQsaHzNq-4kKoCdv0aDJeKx2SvQqLHnYNV9XirCc5SAbojp-C1CHsa7OjA6o0rOrx5rLneplb_EX2pmB01iYBvFpO8o6110oFO2yAC5E6SvWdsfGmZrZ7TZSaR32s4VudVlpurQ Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:58:19.725896 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:58:19.727585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f40d6476c750438c9c09107c7757fa95", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}] Aug 26 15:58:19.727585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:19.727585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:19.727585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:19.727585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:19.727585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:58:19.727585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:58:19.727585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 9348310fd06b473786d1c6be4f20c481 Aug 26 15:58:19.727585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:19.727585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:58:19.727585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. Aug 26 15:58:19.727585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '98f30ecf-6ee4-4098-862e-3f5b5620b188'} Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:19.728505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. Aug 26 15:58:19.729968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.731802 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a062c73a-1d43-430d-a5a5-df60134b8fa8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Returning 404 to user: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:19.731802 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-a062c73a-1d43-430d-a5a5-df60134b8fa8 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "DELETE /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 404 len: 111 microversion: 2.1 time: 0.036446 Aug 26 15:58:19.731802 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 461/928] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:58:19 2022] DELETE /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:58:19.741037 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-71dd57f7-71e6-4da9-a8f4-fc67e9090f69 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:19.742127 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-71dd57f7-71e6-4da9-a8f4-fc67e9090f69 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 98f30ecf-6ee4-4098-862e-3f5b5620b188] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:19.756153 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-71dd57f7-71e6-4da9-a8f4-fc67e9090f69 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:19.756547 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-71dd57f7-71e6-4da9-a8f4-fc67e9090f69 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:19.759746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-71dd57f7-71e6-4da9-a8f4-fc67e9090f69 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:19.759746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-71dd57f7-71e6-4da9-a8f4-fc67e9090f69 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:19.759746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-71dd57f7-71e6-4da9-a8f4-fc67e9090f69 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:19.760604 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-71dd57f7-71e6-4da9-a8f4-fc67e9090f69 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:19.788360 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-71dd57f7-71e6-4da9-a8f4-fc67e9090f69 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] HTTP exception thrown: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-71dd57f7-71e6-4da9-a8f4-fc67e9090f69 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Request method failure captured: Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 HTTP/1.1 Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOwce1DELhS8UmzpwnI-HX_EQrzE1_2dLaZIAb4DQQsaHzNq-4kKoCdv0aDJeKx2SvQqLHnYNV9XirCc5SAbojp-C1CHsa7OjA6o0rOrx5rLneplb_EX2pmB01iYBvFpO8o6110oFO2yAC5E6SvWdsfGmZrZ7TZSaR32s4VudVlpurQ Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:58:19.791469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:58:19.793195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f40d6476c750438c9c09107c7757fa95", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}] Aug 26 15:58:19.793195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:19.793195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:19.793195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:19.793195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:19.793195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:58:19.793195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:58:19.793195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 9348310fd06b473786d1c6be4f20c481 Aug 26 15:58:19.793195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:19.793195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:58:19.793195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. Aug 26 15:58:19.793195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '98f30ecf-6ee4-4098-862e-3f5b5620b188'} Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:19.794123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. Aug 26 15:58:19.795608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.797051 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-71dd57f7-71e6-4da9-a8f4-fc67e9090f69 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Returning 404 to user: Instance 98f30ecf-6ee4-4098-862e-3f5b5620b188 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:19.797051 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-71dd57f7-71e6-4da9-a8f4-fc67e9090f69 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188" status: 404 len: 111 microversion: 2.1 time: 0.060859 Aug 26 15:58:19.797051 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 468/929] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:19 2022] GET /compute/v2.1/servers/98f30ecf-6ee4-4098-862e-3f5b5620b188 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:58:19.803968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1081ec9b-d8f5-4077-9678-839f88382f61 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:19.804478 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-1081ec9b-d8f5-4077-9678-839f88382f61 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:19.812475 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1081ec9b-d8f5-4077-9678-839f88382f61 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:19.817171 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1081ec9b-d8f5-4077-9678-839f88382f61 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:19.817171 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1081ec9b-d8f5-4077-9678-839f88382f61 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:19.817171 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1081ec9b-d8f5-4077-9678-839f88382f61 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:19.817171 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1081ec9b-d8f5-4077-9678-839f88382f61 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:19.817561 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1081ec9b-d8f5-4077-9678-839f88382f61 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:19.833322 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-1081ec9b-d8f5-4077-9678-839f88382f61 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] HTTP exception thrown: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1081ec9b-d8f5-4077-9678-839f88382f61 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Request method failure captured: Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: DELETE /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f HTTP/1.1 Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOwce1DELhS8UmzpwnI-HX_EQrzE1_2dLaZIAb4DQQsaHzNq-4kKoCdv0aDJeKx2SvQqLHnYNV9XirCc5SAbojp-C1CHsa7OjA6o0rOrx5rLneplb_EX2pmB01iYBvFpO8o6110oFO2yAC5E6SvWdsfGmZrZ7TZSaR32s4VudVlpurQ Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:58:19.835149 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:58:19.836890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f40d6476c750438c9c09107c7757fa95", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}] Aug 26 15:58:19.836890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:19.836890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:19.836890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:19.836890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:19.836890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:58:19.836890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:58:19.836890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 9348310fd06b473786d1c6be4f20c481 Aug 26 15:58:19.836890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:19.836890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:58:19.836890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. Aug 26 15:58:19.836890 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '9af463f4-5ec2-4134-81cf-bd9adfc4853f'} Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:19.838043 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. Aug 26 15:58:19.839335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.841383 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1081ec9b-d8f5-4077-9678-839f88382f61 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Returning 404 to user: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:19.841383 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-1081ec9b-d8f5-4077-9678-839f88382f61 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 404 len: 111 microversion: 2.1 time: 0.036519 Aug 26 15:58:19.841383 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 462/930] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:58:19 2022] DELETE /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 15:58:19.845585 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-001888ad-5e71-48d1-ad1d-8ea9f58fabab tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:19.846479 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-001888ad-5e71-48d1-ad1d-8ea9f58fabab tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 9af463f4-5ec2-4134-81cf-bd9adfc4853f] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:19.852916 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-001888ad-5e71-48d1-ad1d-8ea9f58fabab tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:19.853688 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-001888ad-5e71-48d1-ad1d-8ea9f58fabab tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:19.854357 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-001888ad-5e71-48d1-ad1d-8ea9f58fabab tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:19.855065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-001888ad-5e71-48d1-ad1d-8ea9f58fabab tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:19.855509 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-001888ad-5e71-48d1-ad1d-8ea9f58fabab tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:19.856110 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-001888ad-5e71-48d1-ad1d-8ea9f58fabab tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:19.872023 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-001888ad-5e71-48d1-ad1d-8ea9f58fabab tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] HTTP exception thrown: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-001888ad-5e71-48d1-ad1d-8ea9f58fabab tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Request method failure captured: Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f HTTP/1.1 Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCOwce1DELhS8UmzpwnI-HX_EQrzE1_2dLaZIAb4DQQsaHzNq-4kKoCdv0aDJeKx2SvQqLHnYNV9XirCc5SAbojp-C1CHsa7OjA6o0rOrx5rLneplb_EX2pmB01iYBvFpO8o6110oFO2yAC5E6SvWdsfGmZrZ7TZSaR32s4VudVlpurQ Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:58:19.873587 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:58:19.874984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f40d6476c750438c9c09107c7757fa95", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}] Aug 26 15:58:19.874984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:19.874984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:19.874984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:19.874984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:19.874984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:58:19.874984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:58:19.874984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 9348310fd06b473786d1c6be4f20c481 Aug 26 15:58:19.874984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:19.874984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:58:19.874984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. Aug 26 15:58:19.874984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '9af463f4-5ec2-4134-81cf-bd9adfc4853f'} Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:19.875969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. Aug 26 15:58:19.878138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:19.879634 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-001888ad-5e71-48d1-ad1d-8ea9f58fabab tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Returning 404 to user: Instance 9af463f4-5ec2-4134-81cf-bd9adfc4853f could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:19.879634 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-001888ad-5e71-48d1-ad1d-8ea9f58fabab tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f" status: 404 len: 111 microversion: 2.1 time: 0.033545 Aug 26 15:58:19.879634 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 469/931] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:19 2022] GET /compute/v2.1/servers/9af463f4-5ec2-4134-81cf-bd9adfc4853f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 15:58:20.019473 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-03853da0-069c-41dc-847b-2a78a7ee6928 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:20.020108 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-03853da0-069c-41dc-847b-2a78a7ee6928 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:20.026245 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-03853da0-069c-41dc-847b-2a78a7ee6928 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:20.026729 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-03853da0-069c-41dc-847b-2a78a7ee6928 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:20.027162 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-03853da0-069c-41dc-847b-2a78a7ee6928 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:20.027878 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-03853da0-069c-41dc-847b-2a78a7ee6928 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:20.028341 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-03853da0-069c-41dc-847b-2a78a7ee6928 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:20.028892 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-03853da0-069c-41dc-847b-2a78a7ee6928 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:20.101533 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-03853da0-069c-41dc-847b-2a78a7ee6928 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:20.110222 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-03853da0-069c-41dc-847b-2a78a7ee6928 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1143 microversion: 2.1 time: 0.094178 Aug 26 15:58:20.115046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 463/932] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:20 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1143 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:21.140855 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d9ced0e0-cec4-4016-82a5-db525e976029 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:21.141864 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d9ced0e0-cec4-4016-82a5-db525e976029 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:21.153416 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d9ced0e0-cec4-4016-82a5-db525e976029 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:21.154266 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d9ced0e0-cec4-4016-82a5-db525e976029 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:21.155016 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d9ced0e0-cec4-4016-82a5-db525e976029 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:21.156256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d9ced0e0-cec4-4016-82a5-db525e976029 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:21.157085 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d9ced0e0-cec4-4016-82a5-db525e976029 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:21.157888 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d9ced0e0-cec4-4016-82a5-db525e976029 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:21.200794 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f27716a2-f4b6-4836-ab52-53abe3112b43 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:21.201362 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f27716a2-f4b6-4836-ab52-53abe3112b43 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:21.208740 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f27716a2-f4b6-4836-ab52-53abe3112b43 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:21.209231 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f27716a2-f4b6-4836-ab52-53abe3112b43 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:21.209664 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f27716a2-f4b6-4836-ab52-53abe3112b43 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:21.210368 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f27716a2-f4b6-4836-ab52-53abe3112b43 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:21.210827 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f27716a2-f4b6-4836-ab52-53abe3112b43 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:21.211252 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f27716a2-f4b6-4836-ab52-53abe3112b43 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:21.227630 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-f27716a2-f4b6-4836-ab52-53abe3112b43 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] HTTP exception thrown: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f27716a2-f4b6-4836-ab52-53abe3112b43 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Request method failure captured: Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: DELETE /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 HTTP/1.1 Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOwce1DELhS8UmzpwnI-HX_EQrzE1_2dLaZIAb4DQQsaHzNq-4kKoCdv0aDJeKx2SvQqLHnYNV9XirCc5SAbojp-C1CHsa7OjA6o0rOrx5rLneplb_EX2pmB01iYBvFpO8o6110oFO2yAC5E6SvWdsfGmZrZ7TZSaR32s4VudVlpurQ Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:58:21.229260 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:58:21.231857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f40d6476c750438c9c09107c7757fa95", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}] Aug 26 15:58:21.231857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:21.231857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:21.231857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:21.231857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:21.231857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:58:21.231857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:58:21.231857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 9348310fd06b473786d1c6be4f20c481 Aug 26 15:58:21.231857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:21.231857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:58:21.231857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. Aug 26 15:58:21.231857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '241a08df-4027-4153-8284-9ef744c15cb5'} Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:21.233430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. Aug 26 15:58:21.237581 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:21.240678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f27716a2-f4b6-4836-ab52-53abe3112b43 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Returning 404 to user: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:21.240678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f27716a2-f4b6-4836-ab52-53abe3112b43 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "DELETE /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 404 len: 111 microversion: 2.1 time: 0.034410 Aug 26 15:58:21.240678 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 464/933] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 15:58:21 2022] DELETE /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 15:58:21.241262 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d9ced0e0-cec4-4016-82a5-db525e976029 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:21.241496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0ff138a5-5c2c-4ca9-a702-8185c2cb3af3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:21.241496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0ff138a5-5c2c-4ca9-a702-8185c2cb3af3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] [instance: 241a08df-4027-4153-8284-9ef744c15cb5] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:21.247772 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ff138a5-5c2c-4ca9-a702-8185c2cb3af3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:21.248298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ff138a5-5c2c-4ca9-a702-8185c2cb3af3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:21.248744 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ff138a5-5c2c-4ca9-a702-8185c2cb3af3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:21.249438 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ff138a5-5c2c-4ca9-a702-8185c2cb3af3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:21.249892 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ff138a5-5c2c-4ca9-a702-8185c2cb3af3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:21.250319 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ff138a5-5c2c-4ca9-a702-8185c2cb3af3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:21.250720 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d9ced0e0-cec4-4016-82a5-db525e976029 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1191 microversion: 2.1 time: 0.117341 Aug 26 15:58:21.252821 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 470/934] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:21 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1191 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:21.268642 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-0ff138a5-5c2c-4ca9-a702-8185c2cb3af3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] HTTP exception thrown: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0ff138a5-5c2c-4ca9-a702-8185c2cb3af3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Request method failure captured: Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 HTTP/1.1 Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOwce1DELhS8UmzpwnI-HX_EQrzE1_2dLaZIAb4DQQsaHzNq-4kKoCdv0aDJeKx2SvQqLHnYNV9XirCc5SAbojp-C1CHsa7OjA6o0rOrx5rLneplb_EX2pmB01iYBvFpO8o6110oFO2yAC5E6SvWdsfGmZrZ7TZSaR32s4VudVlpurQ Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 15:58:21.270488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 15:58:21.271974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f40d6476c750438c9c09107c7757fa95", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f40d6476c750438c9c09107c7757fa95"}]}] Aug 26 15:58:21.271974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:21.271974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: f40d6476c750438c9c09107c7757fa95 Aug 26 15:58:21.271974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1512116964 Aug 26 15:58:21.271974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:21.271974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 15:58:21.271974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 15:58:21.271974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 9348310fd06b473786d1c6be4f20c481 Aug 26 15:58:21.271974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-AttachVolumeNegativeTest-1512116964-project Aug 26 15:58:21.271974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 15:58:21.271974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. Aug 26 15:58:21.271974 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '241a08df-4027-4153-8284-9ef744c15cb5'} Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:21.272763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. Aug 26 15:58:21.274166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 15:58:21.275298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0ff138a5-5c2c-4ca9-a702-8185c2cb3af3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] Returning 404 to user: Instance 241a08df-4027-4153-8284-9ef744c15cb5 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:21.275298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0ff138a5-5c2c-4ca9-a702-8185c2cb3af3 tempest-AttachVolumeNegativeTest-1512116964 tempest-AttachVolumeNegativeTest-1512116964-project] 10.222.0.98 "GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5" status: 404 len: 111 microversion: 2.1 time: 0.036225 Aug 26 15:58:21.276169 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 465/935] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:21 2022] GET /compute/v2.1/servers/241a08df-4027-4153-8284-9ef744c15cb5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:58:22.286261 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-2c76c610-9b63-40ea-88c7-4793f663c86e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:22.287807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-2c76c610-9b63-40ea-88c7-4793f663c86e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:22.298860 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2c76c610-9b63-40ea-88c7-4793f663c86e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:22.305059 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2c76c610-9b63-40ea-88c7-4793f663c86e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:22.305059 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2c76c610-9b63-40ea-88c7-4793f663c86e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:22.305059 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2c76c610-9b63-40ea-88c7-4793f663c86e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:22.305059 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2c76c610-9b63-40ea-88c7-4793f663c86e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:22.305541 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2c76c610-9b63-40ea-88c7-4793f663c86e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:22.749272 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2c76c610-9b63-40ea-88c7-4793f663c86e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:22.763343 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-2c76c610-9b63-40ea-88c7-4793f663c86e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1276 microversion: 2.1 time: 0.483201 Aug 26 15:58:22.779630 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 471/936] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:22 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1276 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:23.803965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-337de5f6-d0de-4f4c-abc4-4ea6dca1b6bc tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:23.806154 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-337de5f6-d0de-4f4c-abc4-4ea6dca1b6bc tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:23.819170 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-337de5f6-d0de-4f4c-abc4-4ea6dca1b6bc tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:23.820091 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-337de5f6-d0de-4f4c-abc4-4ea6dca1b6bc tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:23.821104 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-337de5f6-d0de-4f4c-abc4-4ea6dca1b6bc tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:23.822619 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-337de5f6-d0de-4f4c-abc4-4ea6dca1b6bc tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:23.823693 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-337de5f6-d0de-4f4c-abc4-4ea6dca1b6bc tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:23.824480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-337de5f6-d0de-4f4c-abc4-4ea6dca1b6bc tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:23.894287 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-a8fbe059-b5c3-499f-b633-df7162da9ecd req-5725205f-b2c7-4e27-8e10-1362067b55c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "668a64a3-6f61-478a-8538-d8cd087f9f8a", "tag": "964e07b3-ad1b-4b31-85e4-93fe4da08f4c"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:23.922628 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-a8fbe059-b5c3-499f-b633-df7162da9ecd req-5725205f-b2c7-4e27-8e10-1362067b55c9 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:23.922628 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-a8fbe059-b5c3-499f-b633-df7162da9ecd req-5725205f-b2c7-4e27-8e10-1362067b55c9 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:23.922628 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-a8fbe059-b5c3-499f-b633-df7162da9ecd req-5725205f-b2c7-4e27-8e10-1362067b55c9 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:23.938803 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-a8fbe059-b5c3-499f-b633-df7162da9ecd req-5725205f-b2c7-4e27-8e10-1362067b55c9 service nova] Creating event network-changed:964e07b3-ad1b-4b31-85e4-93fe4da08f4c for instance 668a64a3-6f61-478a-8538-d8cd087f9f8a on hv-cinder-83124 Aug 26 15:58:23.945601 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-a8fbe059-b5c3-499f-b633-df7162da9ecd req-5725205f-b2c7-4e27-8e10-1362067b55c9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057684 Aug 26 15:58:23.947433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 472/937] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:58:24.187501 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-337de5f6-d0de-4f4c-abc4-4ea6dca1b6bc tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:24.203725 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-337de5f6-d0de-4f4c-abc4-4ea6dca1b6bc tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1264 microversion: 2.1 time: 0.407363 Aug 26 15:58:24.205391 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 466/938] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:23 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1264 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:25.242993 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b49864ab-ffd7-422c-8d81-f43e62b428fb tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:25.244000 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b49864ab-ffd7-422c-8d81-f43e62b428fb tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:25.251735 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b49864ab-ffd7-422c-8d81-f43e62b428fb tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:25.252411 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b49864ab-ffd7-422c-8d81-f43e62b428fb tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:25.252922 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b49864ab-ffd7-422c-8d81-f43e62b428fb tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:25.253866 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b49864ab-ffd7-422c-8d81-f43e62b428fb tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:25.254389 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b49864ab-ffd7-422c-8d81-f43e62b428fb tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:25.254975 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b49864ab-ffd7-422c-8d81-f43e62b428fb tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:25.476869 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b49864ab-ffd7-422c-8d81-f43e62b428fb tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:25.486775 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b49864ab-ffd7-422c-8d81-f43e62b428fb tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1264 microversion: 2.1 time: 0.249280 Aug 26 15:58:25.487681 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 473/939] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:25 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1264 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:26.508730 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-334a04a7-9dc4-44ac-884f-bafaa8ae5f48 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:26.509342 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-334a04a7-9dc4-44ac-884f-bafaa8ae5f48 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:26.512145 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:26.518219 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-334a04a7-9dc4-44ac-884f-bafaa8ae5f48 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:26.518698 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-334a04a7-9dc4-44ac-884f-bafaa8ae5f48 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:26.519137 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-334a04a7-9dc4-44ac-884f-bafaa8ae5f48 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:26.519844 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-334a04a7-9dc4-44ac-884f-bafaa8ae5f48 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:26.520360 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-334a04a7-9dc4-44ac-884f-bafaa8ae5f48 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:26.520783 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-334a04a7-9dc4-44ac-884f-bafaa8ae5f48 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:26.686851 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-334a04a7-9dc4-44ac-884f-bafaa8ae5f48 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:26.707962 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-334a04a7-9dc4-44ac-884f-bafaa8ae5f48 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1264 microversion: 2.1 time: 0.202672 Aug 26 15:58:26.709019 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 467/940] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:26 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:27.733194 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-879f1ad9-e5fa-4438-adab-6bdfce05d524 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:27.735221 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-879f1ad9-e5fa-4438-adab-6bdfce05d524 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:27.745459 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-879f1ad9-e5fa-4438-adab-6bdfce05d524 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:27.746789 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-879f1ad9-e5fa-4438-adab-6bdfce05d524 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:27.747547 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-879f1ad9-e5fa-4438-adab-6bdfce05d524 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:27.749106 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-879f1ad9-e5fa-4438-adab-6bdfce05d524 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:27.749853 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-879f1ad9-e5fa-4438-adab-6bdfce05d524 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:27.750680 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-879f1ad9-e5fa-4438-adab-6bdfce05d524 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:28.106727 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-879f1ad9-e5fa-4438-adab-6bdfce05d524 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:28.116753 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-879f1ad9-e5fa-4438-adab-6bdfce05d524 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1264 microversion: 2.1 time: 0.390714 Aug 26 15:58:28.120996 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 474/941] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:27 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1264 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:29.144163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b0e734cc-b507-4bef-b556-71d241a34007 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:29.145297 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b0e734cc-b507-4bef-b556-71d241a34007 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:29.149623 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:29.150902 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=6 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:29.160032 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b0e734cc-b507-4bef-b556-71d241a34007 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:29.160982 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b0e734cc-b507-4bef-b556-71d241a34007 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:29.161770 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b0e734cc-b507-4bef-b556-71d241a34007 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:29.163062 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b0e734cc-b507-4bef-b556-71d241a34007 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:29.163893 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b0e734cc-b507-4bef-b556-71d241a34007 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:29.164740 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b0e734cc-b507-4bef-b556-71d241a34007 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:29.345249 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-b0e734cc-b507-4bef-b556-71d241a34007 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:29.354403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-b0e734cc-b507-4bef-b556-71d241a34007 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1264 microversion: 2.1 time: 0.218385 Aug 26 15:58:29.355022 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 468/942] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:29 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:30.376921 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-959efa7d-81e6-4503-b69e-be2079bc115c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:30.378094 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-959efa7d-81e6-4503-b69e-be2079bc115c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:30.382045 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:30.390952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-959efa7d-81e6-4503-b69e-be2079bc115c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:30.399375 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-959efa7d-81e6-4503-b69e-be2079bc115c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:30.399375 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-959efa7d-81e6-4503-b69e-be2079bc115c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:30.399375 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-959efa7d-81e6-4503-b69e-be2079bc115c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:30.399375 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-959efa7d-81e6-4503-b69e-be2079bc115c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:30.399809 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-959efa7d-81e6-4503-b69e-be2079bc115c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:30.581541 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-959efa7d-81e6-4503-b69e-be2079bc115c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:30.594211 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-959efa7d-81e6-4503-b69e-be2079bc115c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1264 microversion: 2.1 time: 0.222159 Aug 26 15:58:30.595583 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 475/943] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:30 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:31.628128 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-097f770d-46da-4aa8-82ab-a656b147e9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:31.629188 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-097f770d-46da-4aa8-82ab-a656b147e9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:31.637262 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-097f770d-46da-4aa8-82ab-a656b147e9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:31.638120 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-097f770d-46da-4aa8-82ab-a656b147e9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:31.638877 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-097f770d-46da-4aa8-82ab-a656b147e9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:31.640227 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-097f770d-46da-4aa8-82ab-a656b147e9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:31.641037 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-097f770d-46da-4aa8-82ab-a656b147e9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:31.642382 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-097f770d-46da-4aa8-82ab-a656b147e9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:31.845182 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-097f770d-46da-4aa8-82ab-a656b147e9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:31.855501 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-097f770d-46da-4aa8-82ab-a656b147e9db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1264 microversion: 2.1 time: 0.231945 Aug 26 15:58:31.856247 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 469/944] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:31 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1264 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:32.878194 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6096a4d9-ba36-45a8-a667-77cbe08f5abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:32.879068 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6096a4d9-ba36-45a8-a667-77cbe08f5abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:32.885359 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6096a4d9-ba36-45a8-a667-77cbe08f5abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:32.885848 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6096a4d9-ba36-45a8-a667-77cbe08f5abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:32.886288 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6096a4d9-ba36-45a8-a667-77cbe08f5abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:32.887007 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6096a4d9-ba36-45a8-a667-77cbe08f5abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:32.887445 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6096a4d9-ba36-45a8-a667-77cbe08f5abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:32.887896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6096a4d9-ba36-45a8-a667-77cbe08f5abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:33.054038 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6096a4d9-ba36-45a8-a667-77cbe08f5abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:33.062928 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6096a4d9-ba36-45a8-a667-77cbe08f5abd tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1264 microversion: 2.1 time: 0.189263 Aug 26 15:58:33.064255 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 476/945] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:32 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:33.969903 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-f520f33f-be65-4930-856c-e01581f9bacf req-d0c5b3b9-7583-4306-98b3-fd12289223da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668a64a3-6f61-478a-8538-d8cd087f9f8a", "name": "network-vif-plugged", "status": "completed", "tag": "964e07b3-ad1b-4b31-85e4-93fe4da08f4c"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:33.982236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-f520f33f-be65-4930-856c-e01581f9bacf req-d0c5b3b9-7583-4306-98b3-fd12289223da service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:33.982894 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-f520f33f-be65-4930-856c-e01581f9bacf req-d0c5b3b9-7583-4306-98b3-fd12289223da service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:33.983498 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-f520f33f-be65-4930-856c-e01581f9bacf req-d0c5b3b9-7583-4306-98b3-fd12289223da service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:33.997187 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-f520f33f-be65-4930-856c-e01581f9bacf req-d0c5b3b9-7583-4306-98b3-fd12289223da service nova] Creating event network-vif-plugged:964e07b3-ad1b-4b31-85e4-93fe4da08f4c for instance 668a64a3-6f61-478a-8538-d8cd087f9f8a on hv-cinder-83124 Aug 26 15:58:34.003123 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-f520f33f-be65-4930-856c-e01581f9bacf req-d0c5b3b9-7583-4306-98b3-fd12289223da service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038520 Aug 26 15:58:34.003908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 470/946] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:58:34.085490 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-89f24c88-b0d9-4aba-b8a4-9b4b196c8a2a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:34.086158 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-89f24c88-b0d9-4aba-b8a4-9b4b196c8a2a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:34.096002 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-89f24c88-b0d9-4aba-b8a4-9b4b196c8a2a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:34.096926 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-89f24c88-b0d9-4aba-b8a4-9b4b196c8a2a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:34.107586 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-89f24c88-b0d9-4aba-b8a4-9b4b196c8a2a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:34.107586 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-89f24c88-b0d9-4aba-b8a4-9b4b196c8a2a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:34.107586 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-89f24c88-b0d9-4aba-b8a4-9b4b196c8a2a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:34.107586 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-89f24c88-b0d9-4aba-b8a4-9b4b196c8a2a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:34.270791 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-89f24c88-b0d9-4aba-b8a4-9b4b196c8a2a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:34.280264 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-89f24c88-b0d9-4aba-b8a4-9b4b196c8a2a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1264 microversion: 2.1 time: 0.198695 Aug 26 15:58:34.285192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 477/947] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:34 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:35.303244 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0ea697c6-bdf8-403d-9914-0a2772da9352 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:35.303857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0ea697c6-bdf8-403d-9914-0a2772da9352 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:35.310596 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ea697c6-bdf8-403d-9914-0a2772da9352 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:35.311109 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ea697c6-bdf8-403d-9914-0a2772da9352 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:35.311548 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ea697c6-bdf8-403d-9914-0a2772da9352 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:35.312288 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ea697c6-bdf8-403d-9914-0a2772da9352 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:35.312742 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ea697c6-bdf8-403d-9914-0a2772da9352 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:35.313758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0ea697c6-bdf8-403d-9914-0a2772da9352 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:35.454744 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0ea697c6-bdf8-403d-9914-0a2772da9352 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:35.463063 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0ea697c6-bdf8-403d-9914-0a2772da9352 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1264 microversion: 2.1 time: 0.165278 Aug 26 15:58:35.463639 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 471/948] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:35 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:36.484978 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-aaca8e63-f15b-43af-832e-607f0983c8c2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:36.485932 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-aaca8e63-f15b-43af-832e-607f0983c8c2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:36.488491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:36.493979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aaca8e63-f15b-43af-832e-607f0983c8c2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:36.494471 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aaca8e63-f15b-43af-832e-607f0983c8c2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:36.494908 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aaca8e63-f15b-43af-832e-607f0983c8c2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:36.495636 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aaca8e63-f15b-43af-832e-607f0983c8c2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:36.496117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aaca8e63-f15b-43af-832e-607f0983c8c2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:36.496542 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aaca8e63-f15b-43af-832e-607f0983c8c2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:36.657940 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-aaca8e63-f15b-43af-832e-607f0983c8c2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:36.665985 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-aaca8e63-f15b-43af-832e-607f0983c8c2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1264 microversion: 2.1 time: 0.185736 Aug 26 15:58:36.667188 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 478/949] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:36 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:37.686959 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-438dc798-4e91-4ead-b536-0f0fa90c232f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:37.687711 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-438dc798-4e91-4ead-b536-0f0fa90c232f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:37.695250 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-438dc798-4e91-4ead-b536-0f0fa90c232f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:37.695734 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-438dc798-4e91-4ead-b536-0f0fa90c232f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:37.696196 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-438dc798-4e91-4ead-b536-0f0fa90c232f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:37.696904 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-438dc798-4e91-4ead-b536-0f0fa90c232f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:37.697350 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-438dc798-4e91-4ead-b536-0f0fa90c232f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:37.697802 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-438dc798-4e91-4ead-b536-0f0fa90c232f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:37.874982 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-438dc798-4e91-4ead-b536-0f0fa90c232f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:37.883549 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-438dc798-4e91-4ead-b536-0f0fa90c232f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1264 microversion: 2.1 time: 0.200576 Aug 26 15:58:37.884163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 472/950] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:37 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:38.904856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-58b653d9-2421-4b64-bb86-6d79b5d4e5db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:38.905404 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-58b653d9-2421-4b64-bb86-6d79b5d4e5db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:38.912453 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-58b653d9-2421-4b64-bb86-6d79b5d4e5db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:38.913306 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-58b653d9-2421-4b64-bb86-6d79b5d4e5db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:38.914066 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-58b653d9-2421-4b64-bb86-6d79b5d4e5db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:38.915942 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-58b653d9-2421-4b64-bb86-6d79b5d4e5db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:38.916694 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-58b653d9-2421-4b64-bb86-6d79b5d4e5db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:38.917433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-58b653d9-2421-4b64-bb86-6d79b5d4e5db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:39.086936 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-58b653d9-2421-4b64-bb86-6d79b5d4e5db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:39.096364 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-58b653d9-2421-4b64-bb86-6d79b5d4e5db tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1450 microversion: 2.1 time: 0.195406 Aug 26 15:58:39.096954 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 479/951] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:38 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1450 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:39.121465 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5f48efc8-e33d-4787-825e-7662577bddf1 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:39.122539 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5f48efc8-e33d-4787-825e-7662577bddf1 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:39.133786 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f48efc8-e33d-4787-825e-7662577bddf1 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:39.134615 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f48efc8-e33d-4787-825e-7662577bddf1 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:39.135381 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f48efc8-e33d-4787-825e-7662577bddf1 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:39.136643 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f48efc8-e33d-4787-825e-7662577bddf1 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:39.137475 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f48efc8-e33d-4787-825e-7662577bddf1 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:39.138226 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5f48efc8-e33d-4787-825e-7662577bddf1 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:39.146927 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:39.350294 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-5f48efc8-e33d-4787-825e-7662577bddf1 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:39.359328 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5f48efc8-e33d-4787-825e-7662577bddf1 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1450 microversion: 2.1 time: 0.245253 Aug 26 15:58:39.360239 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 473/952] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:39 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1450 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:42.138530 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-36240af6-b4a7-4a71-b78d-e242fc60602c req-cd118a2e-e88a-4ffd-a9c8-fce31859b536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "668a64a3-6f61-478a-8538-d8cd087f9f8a", "tag": "964e07b3-ad1b-4b31-85e4-93fe4da08f4c"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:42.153641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-36240af6-b4a7-4a71-b78d-e242fc60602c req-cd118a2e-e88a-4ffd-a9c8-fce31859b536 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:42.154363 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-36240af6-b4a7-4a71-b78d-e242fc60602c req-cd118a2e-e88a-4ffd-a9c8-fce31859b536 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:42.155007 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-36240af6-b4a7-4a71-b78d-e242fc60602c req-cd118a2e-e88a-4ffd-a9c8-fce31859b536 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:42.172848 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-36240af6-b4a7-4a71-b78d-e242fc60602c req-cd118a2e-e88a-4ffd-a9c8-fce31859b536 service nova] Creating event network-changed:964e07b3-ad1b-4b31-85e4-93fe4da08f4c for instance 668a64a3-6f61-478a-8538-d8cd087f9f8a on hv-cinder-83124 Aug 26 15:58:42.179895 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-36240af6-b4a7-4a71-b78d-e242fc60602c req-cd118a2e-e88a-4ffd-a9c8-fce31859b536 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045929 Aug 26 15:58:42.180828 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 480/953] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:58:46.715779 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-fc74bb93-a90d-4223-8ea5-ab18f637d31c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:46.716444 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-fc74bb93-a90d-4223-8ea5-ab18f637d31c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:46.724003 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fc74bb93-a90d-4223-8ea5-ab18f637d31c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:46.724491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fc74bb93-a90d-4223-8ea5-ab18f637d31c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:46.724932 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fc74bb93-a90d-4223-8ea5-ab18f637d31c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:46.725641 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fc74bb93-a90d-4223-8ea5-ab18f637d31c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:46.726092 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fc74bb93-a90d-4223-8ea5-ab18f637d31c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:46.726519 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fc74bb93-a90d-4223-8ea5-ab18f637d31c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:46.774392 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-fc74bb93-a90d-4223-8ea5-ab18f637d31c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/os-volume_attachments/d6dfb4ca-b7a0-4ca2-a40b-5f7eadb34e47" status: 200 len: 194 microversion: 2.20 time: 0.062628 Aug 26 15:58:46.775084 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 474/954] 10.222.0.98 () {60 vars in 1454 bytes} [Fri Aug 26 15:58:46 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/os-volume_attachments/d6dfb4ca-b7a0-4ca2-a40b-5f7eadb34e47 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 15:58:46.869008 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f44641d9-8e8c-4834-bd60-095eb3780d73 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:46.870280 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f44641d9-8e8c-4834-bd60-095eb3780d73 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:46.877176 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f44641d9-8e8c-4834-bd60-095eb3780d73 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:46.877718 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f44641d9-8e8c-4834-bd60-095eb3780d73 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:46.878279 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f44641d9-8e8c-4834-bd60-095eb3780d73 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:46.879084 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f44641d9-8e8c-4834-bd60-095eb3780d73 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:46.879650 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f44641d9-8e8c-4834-bd60-095eb3780d73 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:46.880142 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f44641d9-8e8c-4834-bd60-095eb3780d73 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:46.884160 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=74 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:46.989226 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-f44641d9-8e8c-4834-bd60-095eb3780d73 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lazy-loading 'services' on Instance uuid 9c6825d4-cc4d-4688-9532-01a6cee66ea2 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:58:47.194557 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f44641d9-8e8c-4834-bd60-095eb3780d73 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/os-volume_attachments/d6dfb4ca-b7a0-4ca2-a40b-5f7eadb34e47" status: 202 len: 0 microversion: 2.20 time: 0.330268 Aug 26 15:58:47.195429 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 481/955] 10.222.0.98 () {60 vars in 1457 bytes} [Fri Aug 26 15:58:46 2022] DELETE /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/os-volume_attachments/d6dfb4ca-b7a0-4ca2-a40b-5f7eadb34e47 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:58:47.207914 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-08f62924-a0fb-48bb-88e8-932b13eb9203 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:47.211732 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-08f62924-a0fb-48bb-88e8-932b13eb9203 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:47.221130 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-08f62924-a0fb-48bb-88e8-932b13eb9203 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:47.224671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-08f62924-a0fb-48bb-88e8-932b13eb9203 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:47.224671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-08f62924-a0fb-48bb-88e8-932b13eb9203 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:47.224671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-08f62924-a0fb-48bb-88e8-932b13eb9203 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:47.224671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-08f62924-a0fb-48bb-88e8-932b13eb9203 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:47.225222 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-08f62924-a0fb-48bb-88e8-932b13eb9203 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:47.263447 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-08f62924-a0fb-48bb-88e8-932b13eb9203 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062807 Aug 26 15:58:47.269142 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 475/956] 10.222.0.98 () {60 vars in 1343 bytes} [Fri Aug 26 15:58:47 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 15:58:48.278858 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-dd49d926-31b4-45af-b411-677ef1414dc6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:48.282133 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-dd49d926-31b4-45af-b411-677ef1414dc6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:48.289018 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dd49d926-31b4-45af-b411-677ef1414dc6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:48.289506 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dd49d926-31b4-45af-b411-677ef1414dc6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:48.289945 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dd49d926-31b4-45af-b411-677ef1414dc6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:48.290666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dd49d926-31b4-45af-b411-677ef1414dc6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:48.291120 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dd49d926-31b4-45af-b411-677ef1414dc6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:48.291667 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-dd49d926-31b4-45af-b411-677ef1414dc6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:48.335076 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-dd49d926-31b4-45af-b411-677ef1414dc6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061332 Aug 26 15:58:48.336185 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 482/957] 10.222.0.98 () {60 vars in 1343 bytes} [Fri Aug 26 15:58:48 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:58:49.351213 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-64c9ee8c-929b-4356-9416-0024c072b517 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:49.353448 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-64c9ee8c-929b-4356-9416-0024c072b517 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:49.360753 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64c9ee8c-929b-4356-9416-0024c072b517 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:49.361242 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64c9ee8c-929b-4356-9416-0024c072b517 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:49.361702 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64c9ee8c-929b-4356-9416-0024c072b517 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:49.362408 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64c9ee8c-929b-4356-9416-0024c072b517 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:49.362856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64c9ee8c-929b-4356-9416-0024c072b517 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:49.363275 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64c9ee8c-929b-4356-9416-0024c072b517 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:49.396302 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-64c9ee8c-929b-4356-9416-0024c072b517 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048988 Aug 26 15:58:49.397132 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 476/958] 10.222.0.98 () {60 vars in 1343 bytes} [Fri Aug 26 15:58:49 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:49.481502 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f3cab721-abb9-468c-86d9-acecb37b74fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:49.482157 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f3cab721-abb9-468c-86d9-acecb37b74fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:49.489992 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f3cab721-abb9-468c-86d9-acecb37b74fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:49.490686 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f3cab721-abb9-468c-86d9-acecb37b74fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:49.491247 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f3cab721-abb9-468c-86d9-acecb37b74fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:49.492128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f3cab721-abb9-468c-86d9-acecb37b74fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:49.492765 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f3cab721-abb9-468c-86d9-acecb37b74fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:49.493297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f3cab721-abb9-468c-86d9-acecb37b74fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:49.520745 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f3cab721-abb9-468c-86d9-acecb37b74fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Going to try to terminate instance {{(pid=127697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:58:49.853039 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f3cab721-abb9-468c-86d9-acecb37b74fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 204 len: 0 microversion: 2.20 time: 0.375386 Aug 26 15:58:49.853716 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 483/959] 10.222.0.98 () {60 vars in 1280 bytes} [Fri Aug 26 15:58:49 2022] DELETE /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 15:58:49.864705 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ae9a1dc1-bfba-4e15-86eb-3e0ea34fb9e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:49.865365 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ae9a1dc1-bfba-4e15-86eb-3e0ea34fb9e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:49.872009 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae9a1dc1-bfba-4e15-86eb-3e0ea34fb9e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:49.872658 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae9a1dc1-bfba-4e15-86eb-3e0ea34fb9e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:49.873197 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae9a1dc1-bfba-4e15-86eb-3e0ea34fb9e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:49.874125 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae9a1dc1-bfba-4e15-86eb-3e0ea34fb9e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:49.875329 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae9a1dc1-bfba-4e15-86eb-3e0ea34fb9e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:49.875895 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ae9a1dc1-bfba-4e15-86eb-3e0ea34fb9e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:50.030086 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ae9a1dc1-bfba-4e15-86eb-3e0ea34fb9e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:50.046358 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ae9a1dc1-bfba-4e15-86eb-3e0ea34fb9e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:50.049382 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ae9a1dc1-bfba-4e15-86eb-3e0ea34fb9e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:50.051600 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ae9a1dc1-bfba-4e15-86eb-3e0ea34fb9e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1724 microversion: 2.20 time: 0.190699 Aug 26 15:58:50.052694 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 477/960] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:49 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:58:51.092520 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-4d647e73-ba19-4ec3-be6f-c3cabb21bf2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:51.093225 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-4d647e73-ba19-4ec3-be6f-c3cabb21bf2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:51.103001 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4d647e73-ba19-4ec3-be6f-c3cabb21bf2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:51.103965 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4d647e73-ba19-4ec3-be6f-c3cabb21bf2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:51.104700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4d647e73-ba19-4ec3-be6f-c3cabb21bf2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:51.105985 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4d647e73-ba19-4ec3-be6f-c3cabb21bf2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:51.106819 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4d647e73-ba19-4ec3-be6f-c3cabb21bf2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:51.107572 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-4d647e73-ba19-4ec3-be6f-c3cabb21bf2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:51.285629 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-4d647e73-ba19-4ec3-be6f-c3cabb21bf2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:51.294666 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-4d647e73-ba19-4ec3-be6f-c3cabb21bf2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:51.296312 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-4d647e73-ba19-4ec3-be6f-c3cabb21bf2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:51.297470 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-4d647e73-ba19-4ec3-be6f-c3cabb21bf2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1724 microversion: 2.20 time: 0.209698 Aug 26 15:58:51.298059 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 484/961] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:51 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:58:52.321090 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-9c97b240-87f3-4e41-8cb0-2dc53d577a6f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:52.321757 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-9c97b240-87f3-4e41-8cb0-2dc53d577a6f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:52.329333 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9c97b240-87f3-4e41-8cb0-2dc53d577a6f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:52.329819 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9c97b240-87f3-4e41-8cb0-2dc53d577a6f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:52.330251 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9c97b240-87f3-4e41-8cb0-2dc53d577a6f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:52.330968 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9c97b240-87f3-4e41-8cb0-2dc53d577a6f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:52.331412 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9c97b240-87f3-4e41-8cb0-2dc53d577a6f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:52.331843 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9c97b240-87f3-4e41-8cb0-2dc53d577a6f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:52.528735 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-9c97b240-87f3-4e41-8cb0-2dc53d577a6f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:52.537814 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-9c97b240-87f3-4e41-8cb0-2dc53d577a6f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:52.539259 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-9c97b240-87f3-4e41-8cb0-2dc53d577a6f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:52.540487 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-9c97b240-87f3-4e41-8cb0-2dc53d577a6f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1724 microversion: 2.20 time: 0.223511 Aug 26 15:58:52.541150 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 478/962] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:52 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:58:52.961099 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-1001c721-2916-47f0-bc39-cfeae59a2454 req-1b626ad3-e6d3-4e54-97be-2ddabbecffba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6825d4-cc4d-4688-9532-01a6cee66ea2", "name": "network-vif-deleted", "tag": "57bf8f97-285e-4041-93e6-6c458f946244"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:52.976607 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-1001c721-2916-47f0-bc39-cfeae59a2454 req-1b626ad3-e6d3-4e54-97be-2ddabbecffba service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:52.977078 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-1001c721-2916-47f0-bc39-cfeae59a2454 req-1b626ad3-e6d3-4e54-97be-2ddabbecffba service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:52.977713 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-1001c721-2916-47f0-bc39-cfeae59a2454 req-1b626ad3-e6d3-4e54-97be-2ddabbecffba service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:53.003095 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-1001c721-2916-47f0-bc39-cfeae59a2454 req-1b626ad3-e6d3-4e54-97be-2ddabbecffba service nova] Creating event network-vif-deleted:57bf8f97-285e-4041-93e6-6c458f946244 for instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 on hv-cinder-83124 Aug 26 15:58:53.010196 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-1001c721-2916-47f0-bc39-cfeae59a2454 req-1b626ad3-e6d3-4e54-97be-2ddabbecffba service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052493 Aug 26 15:58:53.011235 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 485/963] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:53.564521 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:53.565599 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:53.572790 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:53.573419 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:53.573948 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:53.574993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:53.578270 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:53.579130 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:53.635231 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:53.636263 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:53.636710 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:53.637182 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lazy-loading 'fault' on Instance uuid 9c6825d4-cc4d-4688-9532-01a6cee66ea2 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:58:53.704023 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:53.717014 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:53.719748 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:53.721854 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-885daed9-89d7-4c34-b413-8a830c747aa8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 200 len: 1371 microversion: 2.20 time: 0.161085 Aug 26 15:58:53.722950 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 479/964] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:53 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:58:54.746841 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-337c7cd8-0346-4837-bebb-ea94acfe32df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:54.747542 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-337c7cd8-0346-4837-bebb-ea94acfe32df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:54.754542 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-337c7cd8-0346-4837-bebb-ea94acfe32df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:54.755028 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-337c7cd8-0346-4837-bebb-ea94acfe32df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:54.755465 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-337c7cd8-0346-4837-bebb-ea94acfe32df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:54.756207 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-337c7cd8-0346-4837-bebb-ea94acfe32df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:54.756656 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-337c7cd8-0346-4837-bebb-ea94acfe32df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:54.757198 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-337c7cd8-0346-4837-bebb-ea94acfe32df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:54.772247 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-337c7cd8-0346-4837-bebb-ea94acfe32df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] HTTP exception thrown: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-337c7cd8-0346-4837-bebb-ea94acfe32df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Request method failure captured: Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 HTTP/1.1 Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCO0WO56w3e2qQBQDtdEo3ypvjfFKIpJicHSFJqh83HzgPhKcP4RW100zb8TxjgOJp3rGMgIC_qQM6oLS6wu7C9kTmKZDB1La98_dS7rpr-W2bu3jMynEsO1qqaUbIeCw65VZ8wzv6qQarC7qNs0nFVXMJMvKky3NcO1qTTM-NqoJxls Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: 10b0a72955244448954be539f99435e9 Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 15:58:54.773442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 15:58:54.775374 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/10b0a72955244448954be539f99435e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_10b0a72955244448954be539f99435e9", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/10b0a72955244448954be539f99435e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/10b0a72955244448954be539f99435e9"}]}] Aug 26 15:58:54.775374 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 15:58:54.775374 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: 10b0a72955244448954be539f99435e9 Aug 26 15:58:54.775374 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 15:58:54.775374 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-AttachVolumeShelveTestJSON-1136984052-project Aug 26 15:58:54.775374 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 15:58:54.775374 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 15:58:54.775374 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 91966686fa7f4c5bb326cdb1e2abc1d9 Aug 26 15:58:54.775374 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1136984052-project Aug 26 15:58:54.775374 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 15:58:54.775374 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. Aug 26 15:58:54.775374 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '9c6825d4-cc4d-4688-9532-01a6cee66ea2'} Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:54.776291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. Aug 26 15:58:54.777692 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 15:58:54.778870 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-337c7cd8-0346-4837-bebb-ea94acfe32df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Returning 404 to user: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:54.778870 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-337c7cd8-0346-4837-bebb-ea94acfe32df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 404 len: 111 microversion: 2.20 time: 0.032461 Aug 26 15:58:54.778870 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 486/965] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:54 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 15:58:54.788925 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ffd51029-224b-4d99-9f11-134f77e9c621 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '.version_select at 0x7fbd1e387790>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:54.865420 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ffd51029-224b-4d99-9f11-134f77e9c621 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-920015561" status: 204 len: 0 microversion: 2.20 time: 0.080322 Aug 26 15:58:54.866033 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 480/966] 10.222.0.98 () {60 vars in 1259 bytes} [Fri Aug 26 15:58:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-920015561 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 15:58:55.727007 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0f6a135a-bfcf-4e81-b342-3c600652886c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Action: 'create', calling method: .version_select at 0x7fbd1e2d8310>, body: {"keypair": {"name": "tempest-keypair-2090401074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT7z052yItxVbg705a40lZmkBksHf5TPTalkuX/nmQVCNQx0EGEMOW1OzLZzynasH685KBeecyX44vt+OxS0AQVehaAP78+KigQNxxMGz3mmxY0VUg14WW++xqZE9MiXg=="}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:55.743695 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-0f6a135a-bfcf-4e81-b342-3c600652886c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Getting quotas for project 10b0a72955244448954be539f99435e9. Resources: {'key_pairs'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:58:55.748112 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-0f6a135a-bfcf-4e81-b342-3c600652886c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Getting quotas for user 91966686fa7f4c5bb326cdb1e2abc1d9 and project 10b0a72955244448954be539f99435e9. Resources: {'key_pairs'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:58:55.870958 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0f6a135a-bfcf-4e81-b342-3c600652886c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.147962 Aug 26 15:58:55.871783 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 487/967] 10.222.0.98 () {62 vars in 1200 bytes} [Fri Aug 26 15:58:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 150 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 26 15:58:58.459711 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-310517241", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c85cbb4-dd28-48c8-b45e-6f3238b9e6d1"}], "security_groups": [{"name": "tempest-securitygroup--1038752708"}], "key_name": "tempest-keypair-2090401074", "user_data": "}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:58.470155 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:58.584923 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.network.neutron [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] validate_networks() for [('4c85cbb4-dd28-48c8-b45e-6f3238b9e6d1', None, None, None, None, None)] {{(pid=127698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:58:58.996328 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Flavor limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:58:58.996859 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Image limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:58:58.997466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Flavor pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:58:58.997979 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Image pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:58:58.998494 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:58:59.009178 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:59.009778 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:59.010284 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:59.011054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:59.011549 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:59.012066 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:59.031357 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Getting quotas for project 10b0a72955244448954be539f99435e9. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:58:59.035698 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Getting quotas for user 91966686fa7f4c5bb326cdb1e2abc1d9 and project 10b0a72955244448954be539f99435e9. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:58:59.048302 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Going to run 1 instances... {{(pid=127698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:58:59.050640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:58:59.182272 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-213f2ee5-f748-45ee-aec6-84fec38362be tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.727919 Aug 26 15:58:59.182931 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 481/968] 10.222.0.98 () {62 vars in 1188 bytes} [Fri Aug 26 15:58:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 26 15:58:59.205336 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-2e10b32d-2987-40ec-9296-46181d5a6580 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:59.206362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-2e10b32d-2987-40ec-9296-46181d5a6580 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:59.290920 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2e10b32d-2987-40ec-9296-46181d5a6580 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:59.302668 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2e10b32d-2987-40ec-9296-46181d5a6580 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:59.305546 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2e10b32d-2987-40ec-9296-46181d5a6580 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:59.307067 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-2e10b32d-2987-40ec-9296-46181d5a6580 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1281 microversion: 2.20 time: 0.111467 Aug 26 15:58:59.308081 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 488/969] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:59 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1281 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:00.336507 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-18b3cc37-770d-423d-8966-04008918ee8c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:00.337168 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-18b3cc37-770d-423d-8966-04008918ee8c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:00.343725 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-18b3cc37-770d-423d-8966-04008918ee8c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:00.344269 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-18b3cc37-770d-423d-8966-04008918ee8c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:00.344738 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-18b3cc37-770d-423d-8966-04008918ee8c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:00.345473 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-18b3cc37-770d-423d-8966-04008918ee8c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:00.345939 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-18b3cc37-770d-423d-8966-04008918ee8c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:00.346374 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-18b3cc37-770d-423d-8966-04008918ee8c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:00.415184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-18b3cc37-770d-423d-8966-04008918ee8c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:00.424318 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-18b3cc37-770d-423d-8966-04008918ee8c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:00.425781 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-18b3cc37-770d-423d-8966-04008918ee8c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:00.426903 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-18b3cc37-770d-423d-8966-04008918ee8c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1285 microversion: 2.20 time: 0.095056 Aug 26 15:59:00.427496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 482/970] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:00 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:01.453982 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f27b0f4c-ce99-4d16-b6f8-21c39dc1b1fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:01.455064 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f27b0f4c-ce99-4d16-b6f8-21c39dc1b1fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:01.466813 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f27b0f4c-ce99-4d16-b6f8-21c39dc1b1fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:01.467626 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f27b0f4c-ce99-4d16-b6f8-21c39dc1b1fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:01.468323 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f27b0f4c-ce99-4d16-b6f8-21c39dc1b1fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:01.469387 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f27b0f4c-ce99-4d16-b6f8-21c39dc1b1fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:01.470070 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f27b0f4c-ce99-4d16-b6f8-21c39dc1b1fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:01.470718 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f27b0f4c-ce99-4d16-b6f8-21c39dc1b1fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:01.548589 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f27b0f4c-ce99-4d16-b6f8-21c39dc1b1fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:01.557703 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f27b0f4c-ce99-4d16-b6f8-21c39dc1b1fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:01.559159 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f27b0f4c-ce99-4d16-b6f8-21c39dc1b1fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:01.562633 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f27b0f4c-ce99-4d16-b6f8-21c39dc1b1fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1277 microversion: 2.20 time: 0.114229 Aug 26 15:59:01.562633 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 489/971] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:01 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:02.588458 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-75b34e29-7ad7-412c-b7c1-b64143e6aeef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:02.589354 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-75b34e29-7ad7-412c-b7c1-b64143e6aeef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:02.597344 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-75b34e29-7ad7-412c-b7c1-b64143e6aeef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:02.604563 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-75b34e29-7ad7-412c-b7c1-b64143e6aeef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:02.604563 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-75b34e29-7ad7-412c-b7c1-b64143e6aeef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:02.604563 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-75b34e29-7ad7-412c-b7c1-b64143e6aeef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:02.604563 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-75b34e29-7ad7-412c-b7c1-b64143e6aeef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:02.605225 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-75b34e29-7ad7-412c-b7c1-b64143e6aeef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:02.673307 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-75b34e29-7ad7-412c-b7c1-b64143e6aeef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:02.682860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-75b34e29-7ad7-412c-b7c1-b64143e6aeef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:02.684345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-75b34e29-7ad7-412c-b7c1-b64143e6aeef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:02.685469 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-75b34e29-7ad7-412c-b7c1-b64143e6aeef tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1333 microversion: 2.20 time: 0.101578 Aug 26 15:59:02.686158 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 483/972] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:02 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1333 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:03.709406 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-36232446-6af0-4a69-916c-c0bc076f83d8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:03.710050 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-36232446-6af0-4a69-916c-c0bc076f83d8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:03.717854 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-36232446-6af0-4a69-916c-c0bc076f83d8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:03.718457 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-36232446-6af0-4a69-916c-c0bc076f83d8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:03.718934 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-36232446-6af0-4a69-916c-c0bc076f83d8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:03.719716 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-36232446-6af0-4a69-916c-c0bc076f83d8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:03.720267 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-36232446-6af0-4a69-916c-c0bc076f83d8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:03.720758 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-36232446-6af0-4a69-916c-c0bc076f83d8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:03.790786 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-36232446-6af0-4a69-916c-c0bc076f83d8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:03.800652 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-36232446-6af0-4a69-916c-c0bc076f83d8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:03.802667 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-36232446-6af0-4a69-916c-c0bc076f83d8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:03.803994 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-36232446-6af0-4a69-916c-c0bc076f83d8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1333 microversion: 2.20 time: 0.098721 Aug 26 15:59:03.804673 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 490/973] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:03 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:59:04.829720 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c564fb25-5974-4984-a117-3fb9b272782c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:04.830860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c564fb25-5974-4984-a117-3fb9b272782c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:04.843016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c564fb25-5974-4984-a117-3fb9b272782c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:04.843898 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c564fb25-5974-4984-a117-3fb9b272782c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:04.844683 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c564fb25-5974-4984-a117-3fb9b272782c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:04.845651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c564fb25-5974-4984-a117-3fb9b272782c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:04.846430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c564fb25-5974-4984-a117-3fb9b272782c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:04.847564 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c564fb25-5974-4984-a117-3fb9b272782c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:04.967037 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c564fb25-5974-4984-a117-3fb9b272782c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:04.975834 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c564fb25-5974-4984-a117-3fb9b272782c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:04.977334 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c564fb25-5974-4984-a117-3fb9b272782c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:04.978491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c564fb25-5974-4984-a117-3fb9b272782c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1341 microversion: 2.20 time: 0.154414 Aug 26 15:59:04.979049 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 484/974] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:04 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1341 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:06.006925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9ea67b7b-fb9a-4b2a-88bf-646af551e3de tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:06.009175 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9ea67b7b-fb9a-4b2a-88bf-646af551e3de tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:06.022501 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9ea67b7b-fb9a-4b2a-88bf-646af551e3de tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:06.026254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9ea67b7b-fb9a-4b2a-88bf-646af551e3de tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:06.026254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9ea67b7b-fb9a-4b2a-88bf-646af551e3de tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:06.026254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9ea67b7b-fb9a-4b2a-88bf-646af551e3de tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:06.026254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9ea67b7b-fb9a-4b2a-88bf-646af551e3de tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:06.029685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9ea67b7b-fb9a-4b2a-88bf-646af551e3de tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:06.210129 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9ea67b7b-fb9a-4b2a-88bf-646af551e3de tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:06.221682 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9ea67b7b-fb9a-4b2a-88bf-646af551e3de tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:06.227200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9ea67b7b-fb9a-4b2a-88bf-646af551e3de tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:06.227200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9ea67b7b-fb9a-4b2a-88bf-646af551e3de tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1407 microversion: 2.20 time: 0.223735 Aug 26 15:59:06.227200 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 491/975] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:05 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:07.087180 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-e26707dd-e348-49e0-8c1c-12759a3a1292 req-d6a3f334-7e62-4039-b398-43f77b2f9fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c01966e1-92f0-493e-8ab3-83ac1156bc62", "tag": "63d32d8a-e638-4a51-aaf0-bb470afb21db"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:07.103107 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-e26707dd-e348-49e0-8c1c-12759a3a1292 req-d6a3f334-7e62-4039-b398-43f77b2f9fbf service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:07.103956 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-e26707dd-e348-49e0-8c1c-12759a3a1292 req-d6a3f334-7e62-4039-b398-43f77b2f9fbf service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:07.104823 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-e26707dd-e348-49e0-8c1c-12759a3a1292 req-d6a3f334-7e62-4039-b398-43f77b2f9fbf service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:07.122255 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-e26707dd-e348-49e0-8c1c-12759a3a1292 req-d6a3f334-7e62-4039-b398-43f77b2f9fbf service nova] Creating event network-changed:63d32d8a-e638-4a51-aaf0-bb470afb21db for instance c01966e1-92f0-493e-8ab3-83ac1156bc62 on hv-cinder-83124 Aug 26 15:59:07.131717 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-e26707dd-e348-49e0-8c1c-12759a3a1292 req-d6a3f334-7e62-4039-b398-43f77b2f9fbf service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051278 Aug 26 15:59:07.132625 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 485/976] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:59:07.255400 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-3e17647f-d0e1-446b-834e-d8753f7250ed tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:07.256557 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-3e17647f-d0e1-446b-834e-d8753f7250ed tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:07.262785 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:07.270036 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3e17647f-d0e1-446b-834e-d8753f7250ed tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:07.270883 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3e17647f-d0e1-446b-834e-d8753f7250ed tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:07.271616 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3e17647f-d0e1-446b-834e-d8753f7250ed tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:07.273058 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3e17647f-d0e1-446b-834e-d8753f7250ed tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:07.273803 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3e17647f-d0e1-446b-834e-d8753f7250ed tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:07.274507 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3e17647f-d0e1-446b-834e-d8753f7250ed tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:07.512656 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-3e17647f-d0e1-446b-834e-d8753f7250ed tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:07.521897 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-3e17647f-d0e1-446b-834e-d8753f7250ed tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:07.523425 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-3e17647f-d0e1-446b-834e-d8753f7250ed tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:07.524814 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-3e17647f-d0e1-446b-834e-d8753f7250ed tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1407 microversion: 2.20 time: 0.274196 Aug 26 15:59:07.525389 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 492/977] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:07 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:08.563067 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-294ccbfb-66b0-4b93-a932-da197c4d8b27 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:08.563812 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-294ccbfb-66b0-4b93-a932-da197c4d8b27 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:08.571508 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-294ccbfb-66b0-4b93-a932-da197c4d8b27 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:08.572031 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-294ccbfb-66b0-4b93-a932-da197c4d8b27 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:08.572469 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-294ccbfb-66b0-4b93-a932-da197c4d8b27 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:08.573179 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-294ccbfb-66b0-4b93-a932-da197c4d8b27 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:08.573706 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-294ccbfb-66b0-4b93-a932-da197c4d8b27 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:08.574386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-294ccbfb-66b0-4b93-a932-da197c4d8b27 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:08.734509 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-294ccbfb-66b0-4b93-a932-da197c4d8b27 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:08.742893 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-294ccbfb-66b0-4b93-a932-da197c4d8b27 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:08.744449 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-294ccbfb-66b0-4b93-a932-da197c4d8b27 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:08.745498 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-294ccbfb-66b0-4b93-a932-da197c4d8b27 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1407 microversion: 2.20 time: 0.187127 Aug 26 15:59:08.746061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 486/978] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:08 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:09.769347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-84d6c109-ecdc-430d-8bc4-0c7097b1b913 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:09.770073 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-84d6c109-ecdc-430d-8bc4-0c7097b1b913 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:09.772011 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=6 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:09.776893 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-84d6c109-ecdc-430d-8bc4-0c7097b1b913 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:09.777381 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-84d6c109-ecdc-430d-8bc4-0c7097b1b913 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:09.777818 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-84d6c109-ecdc-430d-8bc4-0c7097b1b913 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:09.778529 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-84d6c109-ecdc-430d-8bc4-0c7097b1b913 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:09.778980 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-84d6c109-ecdc-430d-8bc4-0c7097b1b913 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:09.779943 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-84d6c109-ecdc-430d-8bc4-0c7097b1b913 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:09.930457 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-84d6c109-ecdc-430d-8bc4-0c7097b1b913 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:09.939963 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-84d6c109-ecdc-430d-8bc4-0c7097b1b913 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:09.941409 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-84d6c109-ecdc-430d-8bc4-0c7097b1b913 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:09.942671 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-84d6c109-ecdc-430d-8bc4-0c7097b1b913 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1407 microversion: 2.20 time: 0.177891 Aug 26 15:59:09.943302 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 493/979] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:09 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:59:10.967136 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2085d1a8-aad0-4430-8852-886bbd9ddaf1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:10.967726 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2085d1a8-aad0-4430-8852-886bbd9ddaf1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:10.969799 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:10.970480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=6 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:10.976376 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2085d1a8-aad0-4430-8852-886bbd9ddaf1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:10.976901 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2085d1a8-aad0-4430-8852-886bbd9ddaf1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:10.977744 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2085d1a8-aad0-4430-8852-886bbd9ddaf1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:10.978040 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2085d1a8-aad0-4430-8852-886bbd9ddaf1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:10.978496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2085d1a8-aad0-4430-8852-886bbd9ddaf1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:10.978913 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2085d1a8-aad0-4430-8852-886bbd9ddaf1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:10.981886 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=72 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:11.160215 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2085d1a8-aad0-4430-8852-886bbd9ddaf1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:11.168925 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2085d1a8-aad0-4430-8852-886bbd9ddaf1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:11.171003 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2085d1a8-aad0-4430-8852-886bbd9ddaf1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:11.172189 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2085d1a8-aad0-4430-8852-886bbd9ddaf1 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1407 microversion: 2.20 time: 0.209735 Aug 26 15:59:11.172767 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 487/980] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:10 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:59:12.194998 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d2f21765-8cdc-4a3d-8a46-d73060b9651e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:12.195633 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d2f21765-8cdc-4a3d-8a46-d73060b9651e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:12.203080 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d2f21765-8cdc-4a3d-8a46-d73060b9651e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:12.203613 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d2f21765-8cdc-4a3d-8a46-d73060b9651e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:12.204089 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d2f21765-8cdc-4a3d-8a46-d73060b9651e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:12.204789 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d2f21765-8cdc-4a3d-8a46-d73060b9651e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:12.205238 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d2f21765-8cdc-4a3d-8a46-d73060b9651e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:12.205662 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d2f21765-8cdc-4a3d-8a46-d73060b9651e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:12.350613 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d2f21765-8cdc-4a3d-8a46-d73060b9651e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:12.359470 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d2f21765-8cdc-4a3d-8a46-d73060b9651e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:12.360946 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d2f21765-8cdc-4a3d-8a46-d73060b9651e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:12.362081 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d2f21765-8cdc-4a3d-8a46-d73060b9651e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1407 microversion: 2.20 time: 0.171190 Aug 26 15:59:12.362638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 494/981] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:12 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:13.386933 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-bd6dd45b-d44f-4bb6-8816-27ce922ddf25 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:13.387578 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-bd6dd45b-d44f-4bb6-8816-27ce922ddf25 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:13.395022 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd6dd45b-d44f-4bb6-8816-27ce922ddf25 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:13.395504 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd6dd45b-d44f-4bb6-8816-27ce922ddf25 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:13.395966 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd6dd45b-d44f-4bb6-8816-27ce922ddf25 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:13.396665 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd6dd45b-d44f-4bb6-8816-27ce922ddf25 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:13.397118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd6dd45b-d44f-4bb6-8816-27ce922ddf25 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:13.397540 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd6dd45b-d44f-4bb6-8816-27ce922ddf25 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:13.543241 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-bd6dd45b-d44f-4bb6-8816-27ce922ddf25 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:13.551769 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-bd6dd45b-d44f-4bb6-8816-27ce922ddf25 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:13.553256 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-bd6dd45b-d44f-4bb6-8816-27ce922ddf25 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:13.554367 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-bd6dd45b-d44f-4bb6-8816-27ce922ddf25 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1407 microversion: 2.20 time: 0.171641 Aug 26 15:59:13.555557 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 488/982] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:13 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:14.127809 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-0793a7ff-2f4b-40f9-9dcb-13410f1f6bfa req-46cbbdae-3a6f-4530-9e62-de6b652ad008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01966e1-92f0-493e-8ab3-83ac1156bc62", "name": "network-vif-plugged", "status": "completed", "tag": "63d32d8a-e638-4a51-aaf0-bb470afb21db"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:14.146578 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-0793a7ff-2f4b-40f9-9dcb-13410f1f6bfa req-46cbbdae-3a6f-4530-9e62-de6b652ad008 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:14.147145 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-0793a7ff-2f4b-40f9-9dcb-13410f1f6bfa req-46cbbdae-3a6f-4530-9e62-de6b652ad008 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:14.147684 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-0793a7ff-2f4b-40f9-9dcb-13410f1f6bfa req-46cbbdae-3a6f-4530-9e62-de6b652ad008 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:14.163357 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-0793a7ff-2f4b-40f9-9dcb-13410f1f6bfa req-46cbbdae-3a6f-4530-9e62-de6b652ad008 service nova] Creating event network-vif-plugged:63d32d8a-e638-4a51-aaf0-bb470afb21db for instance c01966e1-92f0-493e-8ab3-83ac1156bc62 on hv-cinder-83124 Aug 26 15:59:14.170975 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-0793a7ff-2f4b-40f9-9dcb-13410f1f6bfa req-46cbbdae-3a6f-4530-9e62-de6b652ad008 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051227 Aug 26 15:59:14.172420 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 495/983] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:59:14.578234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d54f9363-81a0-43d9-a991-a5eb818a37cb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:14.579281 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d54f9363-81a0-43d9-a991-a5eb818a37cb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:14.588125 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d54f9363-81a0-43d9-a991-a5eb818a37cb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:14.588731 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d54f9363-81a0-43d9-a991-a5eb818a37cb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:14.589257 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d54f9363-81a0-43d9-a991-a5eb818a37cb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:14.590238 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d54f9363-81a0-43d9-a991-a5eb818a37cb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:14.591073 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d54f9363-81a0-43d9-a991-a5eb818a37cb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:14.591926 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d54f9363-81a0-43d9-a991-a5eb818a37cb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:14.743477 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d54f9363-81a0-43d9-a991-a5eb818a37cb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:14.753102 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d54f9363-81a0-43d9-a991-a5eb818a37cb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:14.754612 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d54f9363-81a0-43d9-a991-a5eb818a37cb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:14.755777 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d54f9363-81a0-43d9-a991-a5eb818a37cb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1407 microversion: 2.20 time: 0.183307 Aug 26 15:59:14.756443 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 489/984] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:14 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:15.780635 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-93a0482c-ce72-45d9-ad0d-4a81f0db2db2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:15.781368 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-93a0482c-ce72-45d9-ad0d-4a81f0db2db2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:15.788017 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-93a0482c-ce72-45d9-ad0d-4a81f0db2db2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:15.788548 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-93a0482c-ce72-45d9-ad0d-4a81f0db2db2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:15.789026 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-93a0482c-ce72-45d9-ad0d-4a81f0db2db2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:15.789831 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-93a0482c-ce72-45d9-ad0d-4a81f0db2db2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:15.790386 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-93a0482c-ce72-45d9-ad0d-4a81f0db2db2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:15.790925 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-93a0482c-ce72-45d9-ad0d-4a81f0db2db2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:15.933601 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-93a0482c-ce72-45d9-ad0d-4a81f0db2db2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:15.942780 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-93a0482c-ce72-45d9-ad0d-4a81f0db2db2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:15.944524 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-93a0482c-ce72-45d9-ad0d-4a81f0db2db2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:15.945820 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-93a0482c-ce72-45d9-ad0d-4a81f0db2db2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1407 microversion: 2.20 time: 0.170693 Aug 26 15:59:15.946484 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 496/985] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:15 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:16.969117 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ddc00a49-2106-4adc-a939-29942604ab1e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:16.969770 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ddc00a49-2106-4adc-a939-29942604ab1e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:16.976633 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ddc00a49-2106-4adc-a939-29942604ab1e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:16.977116 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ddc00a49-2106-4adc-a939-29942604ab1e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:16.977558 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ddc00a49-2106-4adc-a939-29942604ab1e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:16.978708 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ddc00a49-2106-4adc-a939-29942604ab1e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:16.979167 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ddc00a49-2106-4adc-a939-29942604ab1e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:16.979593 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ddc00a49-2106-4adc-a939-29942604ab1e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:17.128871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ddc00a49-2106-4adc-a939-29942604ab1e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:17.141376 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ddc00a49-2106-4adc-a939-29942604ab1e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:17.141376 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ddc00a49-2106-4adc-a939-29942604ab1e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:17.142748 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ddc00a49-2106-4adc-a939-29942604ab1e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1407 microversion: 2.20 time: 0.177630 Aug 26 15:59:17.143440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 490/986] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:16 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:18.169764 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5b7c936d-02a9-4056-9f4f-25cc8876a14e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:18.170467 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5b7c936d-02a9-4056-9f4f-25cc8876a14e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:18.178682 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5b7c936d-02a9-4056-9f4f-25cc8876a14e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:18.179363 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5b7c936d-02a9-4056-9f4f-25cc8876a14e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:18.179799 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5b7c936d-02a9-4056-9f4f-25cc8876a14e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:18.180548 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5b7c936d-02a9-4056-9f4f-25cc8876a14e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:18.180994 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5b7c936d-02a9-4056-9f4f-25cc8876a14e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:18.181404 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5b7c936d-02a9-4056-9f4f-25cc8876a14e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:18.184241 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:18.344765 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5b7c936d-02a9-4056-9f4f-25cc8876a14e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:18.361816 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5b7c936d-02a9-4056-9f4f-25cc8876a14e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:18.365180 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5b7c936d-02a9-4056-9f4f-25cc8876a14e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:18.367403 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5b7c936d-02a9-4056-9f4f-25cc8876a14e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1407 microversion: 2.20 time: 0.203501 Aug 26 15:59:18.368667 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 497/987] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:18 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:59:19.406477 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-1ac1fa34-8904-41b0-af25-8a3587e5eccb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:19.407205 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-1ac1fa34-8904-41b0-af25-8a3587e5eccb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:19.413933 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1ac1fa34-8904-41b0-af25-8a3587e5eccb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:19.417814 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1ac1fa34-8904-41b0-af25-8a3587e5eccb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:19.417814 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1ac1fa34-8904-41b0-af25-8a3587e5eccb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:19.417814 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1ac1fa34-8904-41b0-af25-8a3587e5eccb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:19.417814 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1ac1fa34-8904-41b0-af25-8a3587e5eccb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:19.418414 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-1ac1fa34-8904-41b0-af25-8a3587e5eccb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:19.568049 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1ac1fa34-8904-41b0-af25-8a3587e5eccb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:19.578438 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1ac1fa34-8904-41b0-af25-8a3587e5eccb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:19.579912 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-1ac1fa34-8904-41b0-af25-8a3587e5eccb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:19.581110 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-1ac1fa34-8904-41b0-af25-8a3587e5eccb tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1600 microversion: 2.20 time: 0.179391 Aug 26 15:59:19.583774 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 491/988] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:19 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1600 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:59:19.615478 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-18cb5922-5309-437c-88c3-fdc6513e8789 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:19.616406 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-18cb5922-5309-437c-88c3-fdc6513e8789 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:19.626611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18cb5922-5309-437c-88c3-fdc6513e8789 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:19.627434 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18cb5922-5309-437c-88c3-fdc6513e8789 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:19.628300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18cb5922-5309-437c-88c3-fdc6513e8789 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:19.629517 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18cb5922-5309-437c-88c3-fdc6513e8789 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:19.630292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18cb5922-5309-437c-88c3-fdc6513e8789 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:19.631053 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18cb5922-5309-437c-88c3-fdc6513e8789 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:19.729617 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-18cb5922-5309-437c-88c3-fdc6513e8789 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.118919 Aug 26 15:59:19.730319 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 498/989] 10.222.0.98 () {60 vars in 1316 bytes} [Fri Aug 26 15:59:19 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:59:21.202976 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-69e3eabe-bcf1-4b72-b388-7016c2cf3d4d req-8d8e9ad1-9309-4cf5-808f-d90f4e56e949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c01966e1-92f0-493e-8ab3-83ac1156bc62", "tag": "63d32d8a-e638-4a51-aaf0-bb470afb21db"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:21.215029 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-69e3eabe-bcf1-4b72-b388-7016c2cf3d4d req-8d8e9ad1-9309-4cf5-808f-d90f4e56e949 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:21.215391 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-69e3eabe-bcf1-4b72-b388-7016c2cf3d4d req-8d8e9ad1-9309-4cf5-808f-d90f4e56e949 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:21.216062 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-69e3eabe-bcf1-4b72-b388-7016c2cf3d4d req-8d8e9ad1-9309-4cf5-808f-d90f4e56e949 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:21.230012 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-69e3eabe-bcf1-4b72-b388-7016c2cf3d4d req-8d8e9ad1-9309-4cf5-808f-d90f4e56e949 service nova] Creating event network-changed:63d32d8a-e638-4a51-aaf0-bb470afb21db for instance c01966e1-92f0-493e-8ab3-83ac1156bc62 on hv-cinder-83124 Aug 26 15:59:21.236396 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-69e3eabe-bcf1-4b72-b388-7016c2cf3d4d req-8d8e9ad1-9309-4cf5-808f-d90f4e56e949 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037565 Aug 26 15:59:21.237015 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 492/990] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 15:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:59:57.418477 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=13 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:57.419503 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=9 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:57.423829 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6456ae9a-75f9-4f05-956a-88b16b4ff8c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:57.424347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6456ae9a-75f9-4f05-956a-88b16b4ff8c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:57.430933 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6456ae9a-75f9-4f05-956a-88b16b4ff8c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:57.433253 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6456ae9a-75f9-4f05-956a-88b16b4ff8c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:57.433253 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6456ae9a-75f9-4f05-956a-88b16b4ff8c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:57.433253 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6456ae9a-75f9-4f05-956a-88b16b4ff8c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:57.433662 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6456ae9a-75f9-4f05-956a-88b16b4ff8c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:57.434041 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6456ae9a-75f9-4f05-956a-88b16b4ff8c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:57.460881 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6456ae9a-75f9-4f05-956a-88b16b4ff8c2 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62/ips" status: 200 len: 152 microversion: 2.20 time: 0.044076 Aug 26 15:59:57.464935 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 499/991] 10.222.0.98 () {60 vars in 1289 bytes} [Fri Aug 26 15:59:57 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 16:00:00.565827 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-6427849e-c4c2-4320-917b-d56c90883965 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:00.566478 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-6427849e-c4c2-4320-917b-d56c90883965 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:00.569093 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:00.569778 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=31 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:00.575693 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6427849e-c4c2-4320-917b-d56c90883965 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:00.576302 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6427849e-c4c2-4320-917b-d56c90883965 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:00.576813 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6427849e-c4c2-4320-917b-d56c90883965 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:00.577599 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6427849e-c4c2-4320-917b-d56c90883965 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:00.578073 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6427849e-c4c2-4320-917b-d56c90883965 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:00.578510 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6427849e-c4c2-4320-917b-d56c90883965 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:00.607083 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-6427849e-c4c2-4320-917b-d56c90883965 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lazy-loading 'flavor' on Instance uuid c01966e1-92f0-493e-8ab3-83ac1156bc62 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:00:01.125660 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-6427849e-c4c2-4320-917b-d56c90883965 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "POST /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62/action" status: 202 len: 0 microversion: 2.20 time: 0.564752 Aug 26 16:00:01.126270 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 493/992] 10.222.0.98 () {62 vars in 1319 bytes} [Fri Aug 26 16:00:00 2022] POST /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:00:01.141821 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-17eb78ad-dd49-414f-ae17-46c574192760 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:01.144458 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-17eb78ad-dd49-414f-ae17-46c574192760 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:01.154757 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-17eb78ad-dd49-414f-ae17-46c574192760 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:01.155502 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-17eb78ad-dd49-414f-ae17-46c574192760 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:01.156270 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-17eb78ad-dd49-414f-ae17-46c574192760 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:01.157571 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-17eb78ad-dd49-414f-ae17-46c574192760 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:01.158361 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-17eb78ad-dd49-414f-ae17-46c574192760 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:01.159178 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-17eb78ad-dd49-414f-ae17-46c574192760 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:01.340417 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-17eb78ad-dd49-414f-ae17-46c574192760 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:01.350225 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-17eb78ad-dd49-414f-ae17-46c574192760 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:01.351725 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-17eb78ad-dd49-414f-ae17-46c574192760 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:01.352974 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-17eb78ad-dd49-414f-ae17-46c574192760 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1724 microversion: 2.20 time: 0.219382 Aug 26 16:00:01.353539 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 500/993] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:01 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:02.377716 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-72a86018-098d-413c-95cb-0d72926431fa tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:02.378521 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-72a86018-098d-413c-95cb-0d72926431fa tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:02.385446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-72a86018-098d-413c-95cb-0d72926431fa tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:02.387059 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-72a86018-098d-413c-95cb-0d72926431fa tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:02.387842 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-72a86018-098d-413c-95cb-0d72926431fa tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:02.389126 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-72a86018-098d-413c-95cb-0d72926431fa tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:02.389726 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-72a86018-098d-413c-95cb-0d72926431fa tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:02.390256 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-72a86018-098d-413c-95cb-0d72926431fa tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:02.546806 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-72a86018-098d-413c-95cb-0d72926431fa tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:02.556648 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-72a86018-098d-413c-95cb-0d72926431fa tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:02.558859 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-72a86018-098d-413c-95cb-0d72926431fa tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:02.560141 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-72a86018-098d-413c-95cb-0d72926431fa tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1724 microversion: 2.20 time: 0.187544 Aug 26 16:00:02.560702 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 494/994] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:02 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:03.592255 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5e8b6e7d-8f85-491e-b672-b2f1f6a017d5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:03.593578 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5e8b6e7d-8f85-491e-b672-b2f1f6a017d5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:03.605924 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e8b6e7d-8f85-491e-b672-b2f1f6a017d5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:03.606922 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e8b6e7d-8f85-491e-b672-b2f1f6a017d5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:03.607983 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e8b6e7d-8f85-491e-b672-b2f1f6a017d5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:03.609266 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e8b6e7d-8f85-491e-b672-b2f1f6a017d5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:03.610080 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e8b6e7d-8f85-491e-b672-b2f1f6a017d5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:03.610848 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5e8b6e7d-8f85-491e-b672-b2f1f6a017d5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:03.787544 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5e8b6e7d-8f85-491e-b672-b2f1f6a017d5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:03.797958 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5e8b6e7d-8f85-491e-b672-b2f1f6a017d5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:03.799434 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5e8b6e7d-8f85-491e-b672-b2f1f6a017d5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:03.800657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5e8b6e7d-8f85-491e-b672-b2f1f6a017d5 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1724 microversion: 2.20 time: 0.214112 Aug 26 16:00:03.801213 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 501/995] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:03 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:04.828837 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a70d9712-d1c9-4ef2-8218-dee43118ccce tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:04.830181 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a70d9712-d1c9-4ef2-8218-dee43118ccce tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:04.838645 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a70d9712-d1c9-4ef2-8218-dee43118ccce tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:04.839127 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a70d9712-d1c9-4ef2-8218-dee43118ccce tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:04.839608 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a70d9712-d1c9-4ef2-8218-dee43118ccce tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:04.840332 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a70d9712-d1c9-4ef2-8218-dee43118ccce tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:04.840780 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a70d9712-d1c9-4ef2-8218-dee43118ccce tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:04.845692 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a70d9712-d1c9-4ef2-8218-dee43118ccce tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:04.991446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-a70d9712-d1c9-4ef2-8218-dee43118ccce tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:05.001064 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-a70d9712-d1c9-4ef2-8218-dee43118ccce tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:05.002502 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-a70d9712-d1c9-4ef2-8218-dee43118ccce tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:05.003666 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-a70d9712-d1c9-4ef2-8218-dee43118ccce tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1724 microversion: 2.20 time: 0.182346 Aug 26 16:00:05.004259 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 495/996] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:04 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:06.028715 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-68bbe90a-7871-4388-8907-05753b327a58 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:06.029782 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-68bbe90a-7871-4388-8907-05753b327a58 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:06.040826 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-68bbe90a-7871-4388-8907-05753b327a58 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:06.040826 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-68bbe90a-7871-4388-8907-05753b327a58 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:06.040826 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-68bbe90a-7871-4388-8907-05753b327a58 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:06.040826 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-68bbe90a-7871-4388-8907-05753b327a58 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:06.042187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-68bbe90a-7871-4388-8907-05753b327a58 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:06.042187 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-68bbe90a-7871-4388-8907-05753b327a58 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:06.433244 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-68bbe90a-7871-4388-8907-05753b327a58 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:06.443151 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-68bbe90a-7871-4388-8907-05753b327a58 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:06.444664 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-68bbe90a-7871-4388-8907-05753b327a58 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:06.445907 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-68bbe90a-7871-4388-8907-05753b327a58 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1724 microversion: 2.20 time: 0.422098 Aug 26 16:00:06.446474 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 502/997] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:06 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1724 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:07.470172 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d97fdd14-5de3-408f-8ca0-e7c6e8254e9f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:07.471078 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d97fdd14-5de3-408f-8ca0-e7c6e8254e9f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:07.477878 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d97fdd14-5de3-408f-8ca0-e7c6e8254e9f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:07.478368 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d97fdd14-5de3-408f-8ca0-e7c6e8254e9f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:07.478810 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d97fdd14-5de3-408f-8ca0-e7c6e8254e9f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:07.480307 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d97fdd14-5de3-408f-8ca0-e7c6e8254e9f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:07.480770 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d97fdd14-5de3-408f-8ca0-e7c6e8254e9f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:07.481192 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d97fdd14-5de3-408f-8ca0-e7c6e8254e9f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:07.714776 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d97fdd14-5de3-408f-8ca0-e7c6e8254e9f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:07.724192 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d97fdd14-5de3-408f-8ca0-e7c6e8254e9f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:07.725657 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d97fdd14-5de3-408f-8ca0-e7c6e8254e9f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:07.726892 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d97fdd14-5de3-408f-8ca0-e7c6e8254e9f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1724 microversion: 2.20 time: 0.260774 Aug 26 16:00:07.727450 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 496/998] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:07 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:08.749627 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-b0b1674f-5b02-4330-b253-6904b766611e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:08.750409 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-b0b1674f-5b02-4330-b253-6904b766611e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:08.757093 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b0b1674f-5b02-4330-b253-6904b766611e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:08.757637 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b0b1674f-5b02-4330-b253-6904b766611e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:08.758123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b0b1674f-5b02-4330-b253-6904b766611e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:08.758969 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b0b1674f-5b02-4330-b253-6904b766611e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:08.759479 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b0b1674f-5b02-4330-b253-6904b766611e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:08.760028 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-b0b1674f-5b02-4330-b253-6904b766611e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:08.903022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b0b1674f-5b02-4330-b253-6904b766611e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:08.911272 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b0b1674f-5b02-4330-b253-6904b766611e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:08.912742 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-b0b1674f-5b02-4330-b253-6904b766611e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:08.913911 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-b0b1674f-5b02-4330-b253-6904b766611e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1724 microversion: 2.20 time: 0.168609 Aug 26 16:00:08.914497 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 503/999] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:08 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:09.938131 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-dd974c9a-cd17-4c6f-aa62-4ef33318ee59 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:09.938765 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-dd974c9a-cd17-4c6f-aa62-4ef33318ee59 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:09.946066 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-dd974c9a-cd17-4c6f-aa62-4ef33318ee59 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:09.946697 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-dd974c9a-cd17-4c6f-aa62-4ef33318ee59 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:09.947491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-dd974c9a-cd17-4c6f-aa62-4ef33318ee59 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:09.948375 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-dd974c9a-cd17-4c6f-aa62-4ef33318ee59 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:09.948931 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-dd974c9a-cd17-4c6f-aa62-4ef33318ee59 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:09.949446 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-dd974c9a-cd17-4c6f-aa62-4ef33318ee59 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:10.096239 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-dd974c9a-cd17-4c6f-aa62-4ef33318ee59 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:10.106604 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-dd974c9a-cd17-4c6f-aa62-4ef33318ee59 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:10.108159 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-dd974c9a-cd17-4c6f-aa62-4ef33318ee59 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:10.109362 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-dd974c9a-cd17-4c6f-aa62-4ef33318ee59 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1724 microversion: 2.20 time: 0.175192 Aug 26 16:00:10.109920 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 497/1000] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:09 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:11.136452 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-210fe41e-cae2-4003-b0f6-83cbce30614d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:11.137151 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-210fe41e-cae2-4003-b0f6-83cbce30614d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:11.145590 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-210fe41e-cae2-4003-b0f6-83cbce30614d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:11.146260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-210fe41e-cae2-4003-b0f6-83cbce30614d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:11.146819 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-210fe41e-cae2-4003-b0f6-83cbce30614d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:11.147731 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-210fe41e-cae2-4003-b0f6-83cbce30614d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:11.148232 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-210fe41e-cae2-4003-b0f6-83cbce30614d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:11.148898 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-210fe41e-cae2-4003-b0f6-83cbce30614d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:11.303824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-210fe41e-cae2-4003-b0f6-83cbce30614d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:11.314766 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-210fe41e-cae2-4003-b0f6-83cbce30614d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:11.316464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-210fe41e-cae2-4003-b0f6-83cbce30614d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:11.317788 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-210fe41e-cae2-4003-b0f6-83cbce30614d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1724 microversion: 2.20 time: 0.186738 Aug 26 16:00:11.318272 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 504/1001] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:11 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:12.341243 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f5e55914-fea6-4cd1-9cb6-aaa395f957ab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:12.341860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f5e55914-fea6-4cd1-9cb6-aaa395f957ab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:12.349427 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f5e55914-fea6-4cd1-9cb6-aaa395f957ab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:12.354585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f5e55914-fea6-4cd1-9cb6-aaa395f957ab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:12.354585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f5e55914-fea6-4cd1-9cb6-aaa395f957ab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:12.354585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f5e55914-fea6-4cd1-9cb6-aaa395f957ab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:12.354585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f5e55914-fea6-4cd1-9cb6-aaa395f957ab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:12.355309 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f5e55914-fea6-4cd1-9cb6-aaa395f957ab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:12.506126 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f5e55914-fea6-4cd1-9cb6-aaa395f957ab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:12.515307 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f5e55914-fea6-4cd1-9cb6-aaa395f957ab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:12.516810 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f5e55914-fea6-4cd1-9cb6-aaa395f957ab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:12.518012 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f5e55914-fea6-4cd1-9cb6-aaa395f957ab tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1745 microversion: 2.20 time: 0.181162 Aug 26 16:00:12.518574 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 498/1002] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:12 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:13.543213 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-65ad0fcd-0c21-48c0-9fd0-5128dc658633 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:13.544001 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-65ad0fcd-0c21-48c0-9fd0-5128dc658633 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:13.551251 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-65ad0fcd-0c21-48c0-9fd0-5128dc658633 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:13.551739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-65ad0fcd-0c21-48c0-9fd0-5128dc658633 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:13.552225 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-65ad0fcd-0c21-48c0-9fd0-5128dc658633 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:13.552953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-65ad0fcd-0c21-48c0-9fd0-5128dc658633 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:13.553418 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-65ad0fcd-0c21-48c0-9fd0-5128dc658633 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:13.553845 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-65ad0fcd-0c21-48c0-9fd0-5128dc658633 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:13.706460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-65ad0fcd-0c21-48c0-9fd0-5128dc658633 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:13.718293 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-65ad0fcd-0c21-48c0-9fd0-5128dc658633 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:13.719956 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-65ad0fcd-0c21-48c0-9fd0-5128dc658633 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:13.721177 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-65ad0fcd-0c21-48c0-9fd0-5128dc658633 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1745 microversion: 2.20 time: 0.182204 Aug 26 16:00:13.721755 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 505/1003] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:13 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:14.745336 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-76eff272-af93-4b87-9a9d-dd06d386bb2e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:14.746030 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-76eff272-af93-4b87-9a9d-dd06d386bb2e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:14.753405 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76eff272-af93-4b87-9a9d-dd06d386bb2e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:14.754063 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76eff272-af93-4b87-9a9d-dd06d386bb2e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:14.754558 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76eff272-af93-4b87-9a9d-dd06d386bb2e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:14.755289 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76eff272-af93-4b87-9a9d-dd06d386bb2e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:14.755779 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76eff272-af93-4b87-9a9d-dd06d386bb2e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:14.756268 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-76eff272-af93-4b87-9a9d-dd06d386bb2e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:14.894005 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-76eff272-af93-4b87-9a9d-dd06d386bb2e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:14.903012 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-76eff272-af93-4b87-9a9d-dd06d386bb2e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:14.909241 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-76eff272-af93-4b87-9a9d-dd06d386bb2e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:14.909241 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-76eff272-af93-4b87-9a9d-dd06d386bb2e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1745 microversion: 2.20 time: 0.165154 Aug 26 16:00:14.909241 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 499/1004] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:14 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:15.929333 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f92ae663-7e38-4a08-8ecf-ff9922c29f24 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:15.929942 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f92ae663-7e38-4a08-8ecf-ff9922c29f24 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:15.937088 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f92ae663-7e38-4a08-8ecf-ff9922c29f24 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:15.937576 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f92ae663-7e38-4a08-8ecf-ff9922c29f24 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:15.938021 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f92ae663-7e38-4a08-8ecf-ff9922c29f24 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:15.938725 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f92ae663-7e38-4a08-8ecf-ff9922c29f24 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:15.939182 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f92ae663-7e38-4a08-8ecf-ff9922c29f24 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:15.939604 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f92ae663-7e38-4a08-8ecf-ff9922c29f24 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:16.085381 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f92ae663-7e38-4a08-8ecf-ff9922c29f24 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:16.094192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f92ae663-7e38-4a08-8ecf-ff9922c29f24 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:16.098657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f92ae663-7e38-4a08-8ecf-ff9922c29f24 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:16.098657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f92ae663-7e38-4a08-8ecf-ff9922c29f24 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1745 microversion: 2.20 time: 0.171499 Aug 26 16:00:16.098657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 506/1005] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:15 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:17.121365 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ee348f0d-7895-4676-953f-43046828d9b6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:17.122225 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ee348f0d-7895-4676-953f-43046828d9b6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:17.129713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ee348f0d-7895-4676-953f-43046828d9b6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:17.130213 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ee348f0d-7895-4676-953f-43046828d9b6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:17.130657 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ee348f0d-7895-4676-953f-43046828d9b6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:17.131376 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ee348f0d-7895-4676-953f-43046828d9b6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:17.131932 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ee348f0d-7895-4676-953f-43046828d9b6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:17.135520 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ee348f0d-7895-4676-953f-43046828d9b6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:17.291607 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ee348f0d-7895-4676-953f-43046828d9b6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:17.301069 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ee348f0d-7895-4676-953f-43046828d9b6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:17.302682 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ee348f0d-7895-4676-953f-43046828d9b6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:17.303985 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ee348f0d-7895-4676-953f-43046828d9b6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1740 microversion: 2.20 time: 0.187395 Aug 26 16:00:17.304653 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 500/1006] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:17 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:18.331820 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-ba1fade2-f929-4f4a-86e8-5dd3aa1370d6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:18.332734 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ba1fade2-f929-4f4a-86e8-5dd3aa1370d6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:18.341494 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ba1fade2-f929-4f4a-86e8-5dd3aa1370d6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:18.342291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ba1fade2-f929-4f4a-86e8-5dd3aa1370d6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:18.343071 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ba1fade2-f929-4f4a-86e8-5dd3aa1370d6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:18.344351 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ba1fade2-f929-4f4a-86e8-5dd3aa1370d6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:18.344913 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ba1fade2-f929-4f4a-86e8-5dd3aa1370d6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:18.345695 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ba1fade2-f929-4f4a-86e8-5dd3aa1370d6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:18.583912 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-08bca81a-b1bd-484c-a9ba-d5da6109ca44 req-b8e74a5e-e45e-491f-b650-6fc130e80b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01966e1-92f0-493e-8ab3-83ac1156bc62", "name": "network-vif-plugged", "status": "completed", "tag": "63d32d8a-e638-4a51-aaf0-bb470afb21db"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:18.597279 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-08bca81a-b1bd-484c-a9ba-d5da6109ca44 req-b8e74a5e-e45e-491f-b650-6fc130e80b8d service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:18.597973 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-08bca81a-b1bd-484c-a9ba-d5da6109ca44 req-b8e74a5e-e45e-491f-b650-6fc130e80b8d service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:18.598422 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-08bca81a-b1bd-484c-a9ba-d5da6109ca44 req-b8e74a5e-e45e-491f-b650-6fc130e80b8d service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:18.614462 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-08bca81a-b1bd-484c-a9ba-d5da6109ca44 req-b8e74a5e-e45e-491f-b650-6fc130e80b8d service nova] Creating event network-vif-plugged:63d32d8a-e638-4a51-aaf0-bb470afb21db for instance c01966e1-92f0-493e-8ab3-83ac1156bc62 on hv-cinder-83124 Aug 26 16:00:18.624829 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ba1fade2-f929-4f4a-86e8-5dd3aa1370d6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:18.626072 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-08bca81a-b1bd-484c-a9ba-d5da6109ca44 req-b8e74a5e-e45e-491f-b650-6fc130e80b8d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052472 Aug 26 16:00:18.628574 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 501/1007] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:00:18.633734 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ba1fade2-f929-4f4a-86e8-5dd3aa1370d6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:18.635810 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ba1fade2-f929-4f4a-86e8-5dd3aa1370d6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:18.637022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-ba1fade2-f929-4f4a-86e8-5dd3aa1370d6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1740 microversion: 2.20 time: 0.310381 Aug 26 16:00:18.637600 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 507/1008] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:18 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1740 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:19.674304 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-173dade4-9a4c-4584-91da-32e60815e25b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:19.675794 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-173dade4-9a4c-4584-91da-32e60815e25b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:19.684484 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-173dade4-9a4c-4584-91da-32e60815e25b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:19.685368 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-173dade4-9a4c-4584-91da-32e60815e25b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:19.686019 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-173dade4-9a4c-4584-91da-32e60815e25b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:19.688372 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-173dade4-9a4c-4584-91da-32e60815e25b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:19.689611 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-173dade4-9a4c-4584-91da-32e60815e25b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:19.690673 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-173dade4-9a4c-4584-91da-32e60815e25b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:19.909293 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-173dade4-9a4c-4584-91da-32e60815e25b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:19.924907 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-173dade4-9a4c-4584-91da-32e60815e25b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:19.926295 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-173dade4-9a4c-4584-91da-32e60815e25b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:19.927502 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-173dade4-9a4c-4584-91da-32e60815e25b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1740 microversion: 2.20 time: 0.268358 Aug 26 16:00:19.928436 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 502/1009] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:19 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:20.960620 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-fc28ec3f-f089-4c88-a283-9edda6223af9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:20.961964 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-fc28ec3f-f089-4c88-a283-9edda6223af9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:20.972756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fc28ec3f-f089-4c88-a283-9edda6223af9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:20.973256 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fc28ec3f-f089-4c88-a283-9edda6223af9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:20.973700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fc28ec3f-f089-4c88-a283-9edda6223af9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:20.974619 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fc28ec3f-f089-4c88-a283-9edda6223af9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:20.975262 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fc28ec3f-f089-4c88-a283-9edda6223af9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:20.975882 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fc28ec3f-f089-4c88-a283-9edda6223af9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:21.172735 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-fc28ec3f-f089-4c88-a283-9edda6223af9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:21.185291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-fc28ec3f-f089-4c88-a283-9edda6223af9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:21.187303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-fc28ec3f-f089-4c88-a283-9edda6223af9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:21.189052 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-fc28ec3f-f089-4c88-a283-9edda6223af9 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1740 microversion: 2.20 time: 0.234408 Aug 26 16:00:21.189926 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 508/1010] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:20 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:22.230455 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-07bda679-62f0-4454-ab65-a01a27bcec2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:22.231080 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-07bda679-62f0-4454-ab65-a01a27bcec2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:22.239436 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07bda679-62f0-4454-ab65-a01a27bcec2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:22.240338 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07bda679-62f0-4454-ab65-a01a27bcec2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:22.240929 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07bda679-62f0-4454-ab65-a01a27bcec2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:22.241873 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07bda679-62f0-4454-ab65-a01a27bcec2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:22.242495 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07bda679-62f0-4454-ab65-a01a27bcec2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:22.242912 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-07bda679-62f0-4454-ab65-a01a27bcec2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:22.576963 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-07bda679-62f0-4454-ab65-a01a27bcec2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:22.593483 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-07bda679-62f0-4454-ab65-a01a27bcec2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:22.595227 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-07bda679-62f0-4454-ab65-a01a27bcec2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:22.596610 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-07bda679-62f0-4454-ab65-a01a27bcec2c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1740 microversion: 2.20 time: 0.384542 Aug 26 16:00:22.597190 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 503/1011] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:22 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1740 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:23.114528 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-afedd2d0-725f-4c73-b7e4-6253d13739a2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:23.115095 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-afedd2d0-725f-4c73-b7e4-6253d13739a2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:23.119756 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 16:00:23.127177 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-cb47875d-b605-4f5c-a509-041e71a652a5 req-53b659f3-db20-4278-82d1-a64df87990ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "668a64a3-6f61-478a-8538-d8cd087f9f8a", "tag": "964e07b3-ad1b-4b31-85e4-93fe4da08f4c"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:23.130821 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Fri Aug 26 16:00:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a (ip 10.222.0.98) !!! Aug 26 16:00:23.149752 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-cb47875d-b605-4f5c-a509-041e71a652a5 req-53b659f3-db20-4278-82d1-a64df87990ea service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:23.151045 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-cb47875d-b605-4f5c-a509-041e71a652a5 req-53b659f3-db20-4278-82d1-a64df87990ea service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:23.152042 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-cb47875d-b605-4f5c-a509-041e71a652a5 req-53b659f3-db20-4278-82d1-a64df87990ea service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:23.155093 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-afedd2d0-725f-4c73-b7e4-6253d13739a2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:23.155812 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-afedd2d0-725f-4c73-b7e4-6253d13739a2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:23.156458 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-afedd2d0-725f-4c73-b7e4-6253d13739a2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:23.157345 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-afedd2d0-725f-4c73-b7e4-6253d13739a2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:23.158259 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-afedd2d0-725f-4c73-b7e4-6253d13739a2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:23.158852 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-afedd2d0-725f-4c73-b7e4-6253d13739a2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:23.177990 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-cb47875d-b605-4f5c-a509-041e71a652a5 req-53b659f3-db20-4278-82d1-a64df87990ea service nova] Creating event network-changed:964e07b3-ad1b-4b31-85e4-93fe4da08f4c for instance 668a64a3-6f61-478a-8538-d8cd087f9f8a on hv-cinder-83124 Aug 26 16:00:23.188329 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-cb47875d-b605-4f5c-a509-041e71a652a5 req-53b659f3-db20-4278-82d1-a64df87990ea service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068630 Aug 26 16:00:23.198268 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-afedd2d0-725f-4c73-b7e4-6253d13739a2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Going to try to terminate instance {{(pid=127697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:00:23.200611 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 504/1012] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:00:23.621135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-f0500f22-963e-4c2b-b1ec-540142845f74 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:23.625085 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-afedd2d0-725f-4c73-b7e4-6253d13739a2 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "DELETE /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 204 len: 0 microversion: 2.1 time: 0.516282 Aug 26 16:00:23.629878 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 509/1013] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 16:00:23 2022] DELETE /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:00:23.635913 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a6d56194-45b1-4b04-9049-2f5ec6c8533c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:23.637694 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-f0500f22-963e-4c2b-b1ec-540142845f74 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:23.641826 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a6d56194-45b1-4b04-9049-2f5ec6c8533c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:23.648720 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f0500f22-963e-4c2b-b1ec-540142845f74 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:23.651615 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f0500f22-963e-4c2b-b1ec-540142845f74 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:23.652357 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f0500f22-963e-4c2b-b1ec-540142845f74 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:23.653118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f0500f22-963e-4c2b-b1ec-540142845f74 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:23.653586 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f0500f22-963e-4c2b-b1ec-540142845f74 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:23.654019 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-f0500f22-963e-4c2b-b1ec-540142845f74 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:23.661195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a6d56194-45b1-4b04-9049-2f5ec6c8533c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:23.661689 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a6d56194-45b1-4b04-9049-2f5ec6c8533c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:23.662170 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a6d56194-45b1-4b04-9049-2f5ec6c8533c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:23.663500 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a6d56194-45b1-4b04-9049-2f5ec6c8533c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:23.663500 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a6d56194-45b1-4b04-9049-2f5ec6c8533c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:23.663972 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a6d56194-45b1-4b04-9049-2f5ec6c8533c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:23.882389 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f0500f22-963e-4c2b-b1ec-540142845f74 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:23.898645 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f0500f22-963e-4c2b-b1ec-540142845f74 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:23.900508 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-f0500f22-963e-4c2b-b1ec-540142845f74 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:23.901944 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-f0500f22-963e-4c2b-b1ec-540142845f74 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1740 microversion: 2.20 time: 0.285929 Aug 26 16:00:23.915000 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a6d56194-45b1-4b04-9049-2f5ec6c8533c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:23.917080 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 505/1014] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:23 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1740 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:23.926563 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a6d56194-45b1-4b04-9049-2f5ec6c8533c tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1574 microversion: 2.1 time: 0.294963 Aug 26 16:00:23.927254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 510/1015] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:23 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1574 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:24.925463 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-072744d3-c61e-43a7-bf49-296e584415df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:24.927695 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-072744d3-c61e-43a7-bf49-296e584415df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:24.932760 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-072744d3-c61e-43a7-bf49-296e584415df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:24.933242 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-072744d3-c61e-43a7-bf49-296e584415df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:24.933676 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-072744d3-c61e-43a7-bf49-296e584415df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:24.934382 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-072744d3-c61e-43a7-bf49-296e584415df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:24.934834 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-072744d3-c61e-43a7-bf49-296e584415df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:24.935275 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-072744d3-c61e-43a7-bf49-296e584415df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:24.960783 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-337648fd-8bf3-4e11-9bc6-421350618727 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:24.961512 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-337648fd-8bf3-4e11-9bc6-421350618727 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:24.969122 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-337648fd-8bf3-4e11-9bc6-421350618727 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:24.969684 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-337648fd-8bf3-4e11-9bc6-421350618727 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:24.970327 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-337648fd-8bf3-4e11-9bc6-421350618727 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:24.971238 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-337648fd-8bf3-4e11-9bc6-421350618727 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:24.971750 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-337648fd-8bf3-4e11-9bc6-421350618727 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:24.972268 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-337648fd-8bf3-4e11-9bc6-421350618727 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:25.115180 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-072744d3-c61e-43a7-bf49-296e584415df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:25.127385 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-072744d3-c61e-43a7-bf49-296e584415df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:25.129386 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-072744d3-c61e-43a7-bf49-296e584415df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:25.130897 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-072744d3-c61e-43a7-bf49-296e584415df tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1740 microversion: 2.20 time: 0.209654 Aug 26 16:00:25.132160 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 506/1016] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:24 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:25.163488 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-337648fd-8bf3-4e11-9bc6-421350618727 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:25.175664 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-337648fd-8bf3-4e11-9bc6-421350618727 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1574 microversion: 2.1 time: 0.218891 Aug 26 16:00:25.188099 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 511/1017] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:24 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1574 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:00:26.155031 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-bad25662-f6b7-4047-bb17-47440301da09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:26.156393 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-bad25662-f6b7-4047-bb17-47440301da09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:26.166474 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bad25662-f6b7-4047-bb17-47440301da09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:26.169870 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bad25662-f6b7-4047-bb17-47440301da09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:26.169870 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bad25662-f6b7-4047-bb17-47440301da09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:26.169870 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bad25662-f6b7-4047-bb17-47440301da09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:26.170786 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bad25662-f6b7-4047-bb17-47440301da09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:26.171470 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bad25662-f6b7-4047-bb17-47440301da09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:26.199719 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0fb2872b-7aea-463a-8981-ab6010763649 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:26.200378 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0fb2872b-7aea-463a-8981-ab6010763649 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:26.209117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0fb2872b-7aea-463a-8981-ab6010763649 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:26.209611 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0fb2872b-7aea-463a-8981-ab6010763649 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:26.210113 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0fb2872b-7aea-463a-8981-ab6010763649 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:26.210824 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0fb2872b-7aea-463a-8981-ab6010763649 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:26.211334 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0fb2872b-7aea-463a-8981-ab6010763649 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:26.211766 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0fb2872b-7aea-463a-8981-ab6010763649 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:26.426128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0fb2872b-7aea-463a-8981-ab6010763649 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:26.436041 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0fb2872b-7aea-463a-8981-ab6010763649 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1574 microversion: 2.1 time: 0.240917 Aug 26 16:00:26.451415 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 512/1018] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:26 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1574 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:00:26.461854 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-bad25662-f6b7-4047-bb17-47440301da09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:26.471669 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-bad25662-f6b7-4047-bb17-47440301da09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:26.473749 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-bad25662-f6b7-4047-bb17-47440301da09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:26.475053 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-bad25662-f6b7-4047-bb17-47440301da09 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1740 microversion: 2.20 time: 0.325041 Aug 26 16:00:26.475858 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 507/1019] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:26 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1740 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:27.469533 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c045faea-60a4-4c50-bb5f-30fa0f02038f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:27.473952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c045faea-60a4-4c50-bb5f-30fa0f02038f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:27.482254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:27.489828 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c045faea-60a4-4c50-bb5f-30fa0f02038f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:27.493628 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c045faea-60a4-4c50-bb5f-30fa0f02038f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:27.504709 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c045faea-60a4-4c50-bb5f-30fa0f02038f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:27.504709 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c045faea-60a4-4c50-bb5f-30fa0f02038f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:27.504709 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c045faea-60a4-4c50-bb5f-30fa0f02038f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:27.506922 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d0d75f5a-4e3c-4883-85a4-1a3ca5236535 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:27.506922 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d0d75f5a-4e3c-4883-85a4-1a3ca5236535 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:27.508792 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c045faea-60a4-4c50-bb5f-30fa0f02038f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:27.534039 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0d75f5a-4e3c-4883-85a4-1a3ca5236535 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:27.535002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0d75f5a-4e3c-4883-85a4-1a3ca5236535 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:27.536236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0d75f5a-4e3c-4883-85a4-1a3ca5236535 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:27.539264 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0d75f5a-4e3c-4883-85a4-1a3ca5236535 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:27.541066 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0d75f5a-4e3c-4883-85a4-1a3ca5236535 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:27.544871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d0d75f5a-4e3c-4883-85a4-1a3ca5236535 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:27.762060 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c045faea-60a4-4c50-bb5f-30fa0f02038f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:27.773261 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c045faea-60a4-4c50-bb5f-30fa0f02038f tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1574 microversion: 2.1 time: 0.317368 Aug 26 16:00:27.775372 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 513/1020] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:27 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1574 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:27.862210 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d0d75f5a-4e3c-4883-85a4-1a3ca5236535 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:27.872877 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:27.877979 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d0d75f5a-4e3c-4883-85a4-1a3ca5236535 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:27.880531 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d0d75f5a-4e3c-4883-85a4-1a3ca5236535 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:27.887037 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d0d75f5a-4e3c-4883-85a4-1a3ca5236535 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1740 microversion: 2.20 time: 0.391489 Aug 26 16:00:27.890758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 508/1021] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:27 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1740 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:28.807341 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-84116ebd-0430-4170-8af2-0b595fe9cc85 req-4e2c815c-88b4-49d4-a166-2796086a208a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668a64a3-6f61-478a-8538-d8cd087f9f8a", "name": "network-vif-deleted", "tag": "964e07b3-ad1b-4b31-85e4-93fe4da08f4c"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:28.811705 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-49366386-4535-43ca-9f5c-a1ab7dd5e552 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:28.812554 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-49366386-4535-43ca-9f5c-a1ab7dd5e552 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:28.820729 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-49366386-4535-43ca-9f5c-a1ab7dd5e552 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:28.821225 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-49366386-4535-43ca-9f5c-a1ab7dd5e552 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:28.822497 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-49366386-4535-43ca-9f5c-a1ab7dd5e552 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:28.823447 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-49366386-4535-43ca-9f5c-a1ab7dd5e552 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:28.823941 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-49366386-4535-43ca-9f5c-a1ab7dd5e552 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:28.827942 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-84116ebd-0430-4170-8af2-0b595fe9cc85 req-4e2c815c-88b4-49d4-a166-2796086a208a service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:28.828108 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-49366386-4535-43ca-9f5c-a1ab7dd5e552 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:28.828442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-84116ebd-0430-4170-8af2-0b595fe9cc85 req-4e2c815c-88b4-49d4-a166-2796086a208a service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:28.828442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-84116ebd-0430-4170-8af2-0b595fe9cc85 req-4e2c815c-88b4-49d4-a166-2796086a208a service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:28.836229 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:28.845355 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-84116ebd-0430-4170-8af2-0b595fe9cc85 req-4e2c815c-88b4-49d4-a166-2796086a208a service nova] Creating event network-vif-deleted:964e07b3-ad1b-4b31-85e4-93fe4da08f4c for instance 668a64a3-6f61-478a-8538-d8cd087f9f8a on hv-cinder-83124 Aug 26 16:00:28.852243 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-84116ebd-0430-4170-8af2-0b595fe9cc85 req-4e2c815c-88b4-49d4-a166-2796086a208a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048857 Aug 26 16:00:28.857272 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 514/1022] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:00:28.903624 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-49366386-4535-43ca-9f5c-a1ab7dd5e552 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:28.917135 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-49366386-4535-43ca-9f5c-a1ab7dd5e552 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1389 microversion: 2.1 time: 0.109450 Aug 26 16:00:28.920369 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 509/1023] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:28 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1389 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:00:28.945742 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-2cc45584-3a50-4c0f-a961-76d9a512c16f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:28.948425 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-2cc45584-3a50-4c0f-a961-76d9a512c16f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:28.956463 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2cc45584-3a50-4c0f-a961-76d9a512c16f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:28.957049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2cc45584-3a50-4c0f-a961-76d9a512c16f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:28.957532 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2cc45584-3a50-4c0f-a961-76d9a512c16f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:28.958246 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2cc45584-3a50-4c0f-a961-76d9a512c16f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:28.958701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2cc45584-3a50-4c0f-a961-76d9a512c16f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:28.959125 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2cc45584-3a50-4c0f-a961-76d9a512c16f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:29.202338 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2cc45584-3a50-4c0f-a961-76d9a512c16f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:29.212898 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2cc45584-3a50-4c0f-a961-76d9a512c16f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:29.214578 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2cc45584-3a50-4c0f-a961-76d9a512c16f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:29.215805 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-2cc45584-3a50-4c0f-a961-76d9a512c16f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1740 microversion: 2.20 time: 0.280888 Aug 26 16:00:29.219976 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 515/1024] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:28 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:29.947554 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e6e5af7a-e915-4535-afe9-57ff0d94eb56 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:29.948326 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e6e5af7a-e915-4535-afe9-57ff0d94eb56 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:29.955761 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e6e5af7a-e915-4535-afe9-57ff0d94eb56 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:29.956295 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e6e5af7a-e915-4535-afe9-57ff0d94eb56 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:29.956734 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e6e5af7a-e915-4535-afe9-57ff0d94eb56 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:29.957450 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e6e5af7a-e915-4535-afe9-57ff0d94eb56 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:29.957902 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e6e5af7a-e915-4535-afe9-57ff0d94eb56 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:29.958329 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e6e5af7a-e915-4535-afe9-57ff0d94eb56 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:29.993001 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e6e5af7a-e915-4535-afe9-57ff0d94eb56 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:29.993646 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e6e5af7a-e915-4535-afe9-57ff0d94eb56 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:29.994232 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e6e5af7a-e915-4535-afe9-57ff0d94eb56 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:29.994515 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-e6e5af7a-e915-4535-afe9-57ff0d94eb56 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lazy-loading 'fault' on Instance uuid 668a64a3-6f61-478a-8538-d8cd087f9f8a {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:00:30.037860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-e6e5af7a-e915-4535-afe9-57ff0d94eb56 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:30.046481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e6e5af7a-e915-4535-afe9-57ff0d94eb56 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 200 len: 1229 microversion: 2.1 time: 0.104036 Aug 26 16:00:30.047065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 510/1025] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:29 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:30.254258 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-19a91ce8-ee59-4385-b2b6-f726f0f496c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:30.255013 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-19a91ce8-ee59-4385-b2b6-f726f0f496c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:30.263486 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-19a91ce8-ee59-4385-b2b6-f726f0f496c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:30.264178 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-19a91ce8-ee59-4385-b2b6-f726f0f496c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:30.264771 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-19a91ce8-ee59-4385-b2b6-f726f0f496c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:30.265675 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-19a91ce8-ee59-4385-b2b6-f726f0f496c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:30.266230 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-19a91ce8-ee59-4385-b2b6-f726f0f496c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:30.266758 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-19a91ce8-ee59-4385-b2b6-f726f0f496c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:30.417335 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-19a91ce8-ee59-4385-b2b6-f726f0f496c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:30.426061 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-19a91ce8-ee59-4385-b2b6-f726f0f496c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:30.427517 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-19a91ce8-ee59-4385-b2b6-f726f0f496c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:30.428834 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-19a91ce8-ee59-4385-b2b6-f726f0f496c7 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1740 microversion: 2.20 time: 0.178693 Aug 26 16:00:30.429398 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 516/1026] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:30 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:31.070220 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5b92e804-f51f-4ab3-88c3-a047294f8b2e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:31.071020 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5b92e804-f51f-4ab3-88c3-a047294f8b2e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 668a64a3-6f61-478a-8538-d8cd087f9f8a] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:31.074546 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=39 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:31.080502 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b92e804-f51f-4ab3-88c3-a047294f8b2e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:31.081121 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b92e804-f51f-4ab3-88c3-a047294f8b2e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:31.081668 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b92e804-f51f-4ab3-88c3-a047294f8b2e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:31.082501 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b92e804-f51f-4ab3-88c3-a047294f8b2e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:31.083039 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b92e804-f51f-4ab3-88c3-a047294f8b2e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:31.083540 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5b92e804-f51f-4ab3-88c3-a047294f8b2e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:31.111985 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-5b92e804-f51f-4ab3-88c3-a047294f8b2e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] HTTP exception thrown: Instance 668a64a3-6f61-478a-8538-d8cd087f9f8a could not be found. Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5b92e804-f51f-4ab3-88c3-a047294f8b2e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Request method failure captured: Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a HTTP/1.1 Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOw0gxYdmgd_KC6T2ZoJoPeBSQ6xSwQ51ggBKd5aVfnrjnSWk0JklefJXHG9ahlE4M8RPaAlFGIl7_7J8XrqPa-v1c1e98cyQQ7UrHyOzzdeRhvgBVmIPFFpTmfAzqqWpnI7-sH_xS4ckOyOXl6MQDH96OkFe0FDbRSPxZuiKT1_D0s Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: d19b01b0af6c43feb357799d8ae948e1 Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-TestVolumeBootPattern-107255747 Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 16:00:31.113671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 16:00:31.115758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d19b01b0af6c43feb357799d8ae948e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d19b01b0af6c43feb357799d8ae948e1", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d19b01b0af6c43feb357799d8ae948e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d19b01b0af6c43feb357799d8ae948e1"}]}] Aug 26 16:00:31.115758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-TestVolumeBootPattern-107255747 Aug 26 16:00:31.115758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: d19b01b0af6c43feb357799d8ae948e1 Aug 26 16:00:31.115758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-TestVolumeBootPattern-107255747 Aug 26 16:00:31.115758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-TestVolumeBootPattern-107255747-project Aug 26 16:00:31.115758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 16:00:31.115758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 16:00:31.115758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 436adf49f3e24e03971017ea6dd33ac8 Aug 26 16:00:31.115758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-TestVolumeBootPattern-107255747-project Aug 26 16:00:31.115758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 16:00:31.115758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance 668a64a3-6f61-478a-8538-d8cd087f9f8a could not be found. Aug 26 16:00:31.115758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '668a64a3-6f61-478a-8538-d8cd087f9f8a'} Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 668a64a3-6f61-478a-8538-d8cd087f9f8a could not be found. Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:00:31.116965 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 668a64a3-6f61-478a-8538-d8cd087f9f8a could not be found. Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 668a64a3-6f61-478a-8538-d8cd087f9f8a could not be found. Aug 26 16:00:31.120651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:31.123220 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5b92e804-f51f-4ab3-88c3-a047294f8b2e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Returning 404 to user: Instance 668a64a3-6f61-478a-8538-d8cd087f9f8a could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:00:31.123220 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5b92e804-f51f-4ab3-88c3-a047294f8b2e tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a" status: 404 len: 111 microversion: 2.1 time: 0.050838 Aug 26 16:00:31.123220 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 511/1027] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:31 2022] GET /compute/v2.1/servers/668a64a3-6f61-478a-8538-d8cd087f9f8a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:00:31.456540 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-64312581-ab51-4d1c-8839-5d26c09dad0f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:31.458535 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-64312581-ab51-4d1c-8839-5d26c09dad0f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:31.465543 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-64312581-ab51-4d1c-8839-5d26c09dad0f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:31.466037 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-64312581-ab51-4d1c-8839-5d26c09dad0f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:31.466478 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-64312581-ab51-4d1c-8839-5d26c09dad0f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:31.467191 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-64312581-ab51-4d1c-8839-5d26c09dad0f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:31.467646 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-64312581-ab51-4d1c-8839-5d26c09dad0f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:31.468109 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-64312581-ab51-4d1c-8839-5d26c09dad0f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:31.614989 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-64312581-ab51-4d1c-8839-5d26c09dad0f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:31.623744 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-64312581-ab51-4d1c-8839-5d26c09dad0f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:31.625205 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-64312581-ab51-4d1c-8839-5d26c09dad0f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:31.626369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-64312581-ab51-4d1c-8839-5d26c09dad0f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1722 microversion: 2.20 time: 0.174971 Aug 26 16:00:31.626928 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 517/1028] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:31 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:32.650468 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-9a96456f-f9f5-43a7-aae5-69ec1d3d9c21 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:32.651129 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-9a96456f-f9f5-43a7-aae5-69ec1d3d9c21 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:32.658089 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a96456f-f9f5-43a7-aae5-69ec1d3d9c21 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:32.658611 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a96456f-f9f5-43a7-aae5-69ec1d3d9c21 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:32.659042 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a96456f-f9f5-43a7-aae5-69ec1d3d9c21 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:32.659849 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a96456f-f9f5-43a7-aae5-69ec1d3d9c21 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:32.660352 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a96456f-f9f5-43a7-aae5-69ec1d3d9c21 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:32.660770 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a96456f-f9f5-43a7-aae5-69ec1d3d9c21 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:32.810825 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-9a96456f-f9f5-43a7-aae5-69ec1d3d9c21 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:32.819959 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-9a96456f-f9f5-43a7-aae5-69ec1d3d9c21 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:32.822325 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-9a96456f-f9f5-43a7-aae5-69ec1d3d9c21 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:32.823628 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-9a96456f-f9f5-43a7-aae5-69ec1d3d9c21 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1722 microversion: 2.20 time: 0.177751 Aug 26 16:00:32.824556 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 512/1029] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:32 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:33.847752 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c1e63a26-305e-4819-8e25-5e50e9f50bbd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:33.849065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c1e63a26-305e-4819-8e25-5e50e9f50bbd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:33.857642 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c1e63a26-305e-4819-8e25-5e50e9f50bbd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:33.858087 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c1e63a26-305e-4819-8e25-5e50e9f50bbd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:33.858736 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c1e63a26-305e-4819-8e25-5e50e9f50bbd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:33.859445 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c1e63a26-305e-4819-8e25-5e50e9f50bbd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:33.859917 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c1e63a26-305e-4819-8e25-5e50e9f50bbd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:33.860336 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c1e63a26-305e-4819-8e25-5e50e9f50bbd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:34.182774 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c1e63a26-305e-4819-8e25-5e50e9f50bbd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:34.192269 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c1e63a26-305e-4819-8e25-5e50e9f50bbd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:34.193904 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c1e63a26-305e-4819-8e25-5e50e9f50bbd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:34.203951 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c1e63a26-305e-4819-8e25-5e50e9f50bbd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1725 microversion: 2.20 time: 0.351789 Aug 26 16:00:34.203951 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 518/1030] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:33 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1725 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:34.235552 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d04b0c2d-f972-4955-99d8-998bfeebff52 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "add35612-6e54-4f5c-8ae7-7c59bddd17e6"}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:34.238312 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d04b0c2d-f972-4955-99d8-998bfeebff52 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:34.246340 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d04b0c2d-f972-4955-99d8-998bfeebff52 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:34.246881 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d04b0c2d-f972-4955-99d8-998bfeebff52 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:34.247659 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d04b0c2d-f972-4955-99d8-998bfeebff52 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:34.248464 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d04b0c2d-f972-4955-99d8-998bfeebff52 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:34.248940 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d04b0c2d-f972-4955-99d8-998bfeebff52 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:34.249543 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d04b0c2d-f972-4955-99d8-998bfeebff52 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:34.432911 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-f0fd347f-eb95-46c5-a56a-5de34ff4087c req-fbdc0329-93b1-4829-9d7d-58602d40106f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01966e1-92f0-493e-8ab3-83ac1156bc62", "name": "network-vif-unplugged", "status": "completed", "tag": "63d32d8a-e638-4a51-aaf0-bb470afb21db"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:34.444871 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-f0fd347f-eb95-46c5-a56a-5de34ff4087c req-fbdc0329-93b1-4829-9d7d-58602d40106f service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:34.445203 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-f0fd347f-eb95-46c5-a56a-5de34ff4087c req-fbdc0329-93b1-4829-9d7d-58602d40106f service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:34.445636 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-f0fd347f-eb95-46c5-a56a-5de34ff4087c req-fbdc0329-93b1-4829-9d7d-58602d40106f service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:34.459582 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-f0fd347f-eb95-46c5-a56a-5de34ff4087c req-fbdc0329-93b1-4829-9d7d-58602d40106f service nova] Creating event network-vif-unplugged:63d32d8a-e638-4a51-aaf0-bb470afb21db for instance c01966e1-92f0-493e-8ab3-83ac1156bc62 on hv-cinder-83124 Aug 26 16:00:34.466775 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-f0fd347f-eb95-46c5-a56a-5de34ff4087c req-fbdc0329-93b1-4829-9d7d-58602d40106f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039963 Aug 26 16:00:34.467380 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 519/1031] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:00:34.997506 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-ab8ae80e-931c-4f0d-ad4c-7a98c7bfba92 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:34.998186 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ab8ae80e-931c-4f0d-ad4c-7a98c7bfba92 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:35.009800 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ab8ae80e-931c-4f0d-ad4c-7a98c7bfba92 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:35.011827 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ab8ae80e-931c-4f0d-ad4c-7a98c7bfba92 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:35.011827 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ab8ae80e-931c-4f0d-ad4c-7a98c7bfba92 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:35.012459 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ab8ae80e-931c-4f0d-ad4c-7a98c7bfba92 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:35.012882 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ab8ae80e-931c-4f0d-ad4c-7a98c7bfba92 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:35.013312 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ab8ae80e-931c-4f0d-ad4c-7a98c7bfba92 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:35.042701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ab8ae80e-931c-4f0d-ad4c-7a98c7bfba92 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Going to try to terminate instance {{(pid=127697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:00:35.409006 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-ab8ae80e-931c-4f0d-ad4c-7a98c7bfba92 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "DELETE /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 204 len: 0 microversion: 2.1 time: 0.420137 Aug 26 16:00:35.409808 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 520/1032] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 16:00:34 2022] DELETE /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 16:00:35.417935 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-92995ced-d121-4b31-82e6-5f419de6906c req-408ef4de-2995-474d-88db-8e653d2d4887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40898498-b30e-4c04-bef4-fca5f87da4c0", "tag": "9143864b-8fdf-40b9-bf7b-dddb7bfa986e"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:35.429586 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-92995ced-d121-4b31-82e6-5f419de6906c req-408ef4de-2995-474d-88db-8e653d2d4887 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:35.430171 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-92995ced-d121-4b31-82e6-5f419de6906c req-408ef4de-2995-474d-88db-8e653d2d4887 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:35.431134 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-92995ced-d121-4b31-82e6-5f419de6906c req-408ef4de-2995-474d-88db-8e653d2d4887 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:35.444156 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-92995ced-d121-4b31-82e6-5f419de6906c req-408ef4de-2995-474d-88db-8e653d2d4887 service nova] Creating event network-changed:9143864b-8fdf-40b9-bf7b-dddb7bfa986e for instance 40898498-b30e-4c04-bef4-fca5f87da4c0 on hv-cinder-83124 Aug 26 16:00:35.449909 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-92995ced-d121-4b31-82e6-5f419de6906c req-408ef4de-2995-474d-88db-8e653d2d4887 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038226 Aug 26 16:00:35.450519 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 521/1033] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:00:35.456974 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-21e1c126-2662-46e0-b77f-40556bb315e8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:35.457893 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-21e1c126-2662-46e0-b77f-40556bb315e8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:35.464636 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-21e1c126-2662-46e0-b77f-40556bb315e8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:35.465118 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-21e1c126-2662-46e0-b77f-40556bb315e8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:35.470419 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-21e1c126-2662-46e0-b77f-40556bb315e8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:35.470419 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-21e1c126-2662-46e0-b77f-40556bb315e8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:35.470419 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-21e1c126-2662-46e0-b77f-40556bb315e8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:35.470419 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-21e1c126-2662-46e0-b77f-40556bb315e8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:35.482208 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d04b0c2d-f972-4955-99d8-998bfeebff52 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "POST /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.250356 Aug 26 16:00:35.490786 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 513/1034] 10.222.0.98 () {62 vars in 1364 bytes} [Fri Aug 26 16:00:34 2022] POST /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62/os-volume_attachments => generated 188 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 16:00:35.675332 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-21e1c126-2662-46e0-b77f-40556bb315e8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:35.682303 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d92d885d-8e7c-426d-8338-0894a7f25205 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:35.683054 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d92d885d-8e7c-426d-8338-0894a7f25205 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:35.689844 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d92d885d-8e7c-426d-8338-0894a7f25205 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:35.690085 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-21e1c126-2662-46e0-b77f-40556bb315e8 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1574 microversion: 2.1 time: 0.237249 Aug 26 16:00:35.690331 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d92d885d-8e7c-426d-8338-0894a7f25205 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:35.690993 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d92d885d-8e7c-426d-8338-0894a7f25205 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:35.691768 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d92d885d-8e7c-426d-8338-0894a7f25205 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:35.692351 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d92d885d-8e7c-426d-8338-0894a7f25205 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:35.692781 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d92d885d-8e7c-426d-8338-0894a7f25205 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:35.704736 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 522/1035] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:35 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1574 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:36.373481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d92d885d-8e7c-426d-8338-0894a7f25205 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62/os-volume_attachments/add35612-6e54-4f5c-8ae7-7c59bddd17e6" status: 202 len: 0 microversion: 2.20 time: 0.695269 Aug 26 16:00:36.374241 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 514/1036] 10.222.0.98 () {60 vars in 1457 bytes} [Fri Aug 26 16:00:35 2022] DELETE /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62/os-volume_attachments/add35612-6e54-4f5c-8ae7-7c59bddd17e6 => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 26 16:00:36.442858 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a4cc9480-6ba4-4f85-914f-9695cd0ec28a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:36.443417 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a4cc9480-6ba4-4f85-914f-9695cd0ec28a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:36.451075 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a4cc9480-6ba4-4f85-914f-9695cd0ec28a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:36.451560 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a4cc9480-6ba4-4f85-914f-9695cd0ec28a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:36.452074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a4cc9480-6ba4-4f85-914f-9695cd0ec28a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:36.452777 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a4cc9480-6ba4-4f85-914f-9695cd0ec28a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:36.453231 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a4cc9480-6ba4-4f85-914f-9695cd0ec28a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:36.453670 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a4cc9480-6ba4-4f85-914f-9695cd0ec28a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:36.610532 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a4cc9480-6ba4-4f85-914f-9695cd0ec28a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127697) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 16:00:36.724870 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-32005689-569a-419b-9337-43819707ed19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:36.725601 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-32005689-569a-419b-9337-43819707ed19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:36.732711 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-32005689-569a-419b-9337-43819707ed19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:36.733200 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-32005689-569a-419b-9337-43819707ed19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:36.733634 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-32005689-569a-419b-9337-43819707ed19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:36.734327 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-32005689-569a-419b-9337-43819707ed19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:36.734776 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-32005689-569a-419b-9337-43819707ed19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:36.735200 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-32005689-569a-419b-9337-43819707ed19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:36.879384 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-32005689-569a-419b-9337-43819707ed19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:36.887502 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-32005689-569a-419b-9337-43819707ed19 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1574 microversion: 2.1 time: 0.166539 Aug 26 16:00:36.888151 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 515/1037] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:36 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:00:36.926202 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a4cc9480-6ba4-4f85-914f-9695cd0ec28a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "POST /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62/action" status: 202 len: 0 microversion: 2.20 time: 0.487331 Aug 26 16:00:36.926814 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 523/1038] 10.222.0.98 () {62 vars in 1319 bytes} [Fri Aug 26 16:00:36 2022] POST /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 26 16:00:36.936730 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3740615e-ddbe-402c-9e87-32fbe486d5ac tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:36.937408 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3740615e-ddbe-402c-9e87-32fbe486d5ac tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:36.943456 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3740615e-ddbe-402c-9e87-32fbe486d5ac tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:36.943970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3740615e-ddbe-402c-9e87-32fbe486d5ac tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:36.944403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3740615e-ddbe-402c-9e87-32fbe486d5ac tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:36.945749 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3740615e-ddbe-402c-9e87-32fbe486d5ac tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:36.945749 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3740615e-ddbe-402c-9e87-32fbe486d5ac tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:36.945979 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3740615e-ddbe-402c-9e87-32fbe486d5ac tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:37.128984 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3740615e-ddbe-402c-9e87-32fbe486d5ac tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:37.144491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3740615e-ddbe-402c-9e87-32fbe486d5ac tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:37.147396 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3740615e-ddbe-402c-9e87-32fbe486d5ac tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:37.150803 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3740615e-ddbe-402c-9e87-32fbe486d5ac tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1673 microversion: 2.20 time: 0.218803 Aug 26 16:00:37.152072 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 516/1039] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:36 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1673 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:37.832715 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-76f083a8-3ee8-48da-9f4c-781c811328b5 req-2267cc51-2226-409c-a869-f051e4363866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40898498-b30e-4c04-bef4-fca5f87da4c0", "name": "network-vif-deleted", "tag": "9143864b-8fdf-40b9-bf7b-dddb7bfa986e"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:37.859997 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-76f083a8-3ee8-48da-9f4c-781c811328b5 req-2267cc51-2226-409c-a869-f051e4363866 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:37.860573 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-76f083a8-3ee8-48da-9f4c-781c811328b5 req-2267cc51-2226-409c-a869-f051e4363866 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:37.860988 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-76f083a8-3ee8-48da-9f4c-781c811328b5 req-2267cc51-2226-409c-a869-f051e4363866 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:37.874002 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-76f083a8-3ee8-48da-9f4c-781c811328b5 req-2267cc51-2226-409c-a869-f051e4363866 service nova] Creating event network-vif-deleted:9143864b-8fdf-40b9-bf7b-dddb7bfa986e for instance 40898498-b30e-4c04-bef4-fca5f87da4c0 on hv-cinder-83124 Aug 26 16:00:37.879133 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-76f083a8-3ee8-48da-9f4c-781c811328b5 req-2267cc51-2226-409c-a869-f051e4363866 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141548 Aug 26 16:00:37.879837 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 524/1040] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:00:37.909641 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-bd99523a-c9dd-448b-b09c-cf19368bb0ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:37.910476 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-bd99523a-c9dd-448b-b09c-cf19368bb0ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:37.918139 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd99523a-c9dd-448b-b09c-cf19368bb0ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:37.918618 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd99523a-c9dd-448b-b09c-cf19368bb0ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:37.919292 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd99523a-c9dd-448b-b09c-cf19368bb0ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:37.920347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd99523a-c9dd-448b-b09c-cf19368bb0ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:37.921029 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd99523a-c9dd-448b-b09c-cf19368bb0ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:37.921651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-bd99523a-c9dd-448b-b09c-cf19368bb0ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:37.995769 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-bd99523a-c9dd-448b-b09c-cf19368bb0ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:38.004314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-bd99523a-c9dd-448b-b09c-cf19368bb0ec tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1224 microversion: 2.1 time: 0.098645 Aug 26 16:00:38.008295 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 517/1041] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:37 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:00:38.198808 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-cf062c32-cc4b-40b2-a466-cc66d19e3c6b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:38.199829 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-cf062c32-cc4b-40b2-a466-cc66d19e3c6b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:38.208533 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf062c32-cc4b-40b2-a466-cc66d19e3c6b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:38.209695 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf062c32-cc4b-40b2-a466-cc66d19e3c6b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:38.209695 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf062c32-cc4b-40b2-a466-cc66d19e3c6b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:38.210384 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf062c32-cc4b-40b2-a466-cc66d19e3c6b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:38.210843 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf062c32-cc4b-40b2-a466-cc66d19e3c6b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:38.211268 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cf062c32-cc4b-40b2-a466-cc66d19e3c6b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:38.383128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cf062c32-cc4b-40b2-a466-cc66d19e3c6b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:38.393244 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cf062c32-cc4b-40b2-a466-cc66d19e3c6b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:38.395414 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cf062c32-cc4b-40b2-a466-cc66d19e3c6b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:38.396909 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-cf062c32-cc4b-40b2-a466-cc66d19e3c6b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1673 microversion: 2.20 time: 0.208094 Aug 26 16:00:38.397678 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 525/1042] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:38 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1673 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:39.029110 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3fd8a97d-7939-41bb-91ca-c8010af068b9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:39.029729 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3fd8a97d-7939-41bb-91ca-c8010af068b9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:39.036726 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3fd8a97d-7939-41bb-91ca-c8010af068b9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:39.037216 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3fd8a97d-7939-41bb-91ca-c8010af068b9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:39.037761 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3fd8a97d-7939-41bb-91ca-c8010af068b9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:39.038587 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3fd8a97d-7939-41bb-91ca-c8010af068b9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:39.039111 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3fd8a97d-7939-41bb-91ca-c8010af068b9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:39.039536 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3fd8a97d-7939-41bb-91ca-c8010af068b9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:39.074456 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3fd8a97d-7939-41bb-91ca-c8010af068b9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:39.074941 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3fd8a97d-7939-41bb-91ca-c8010af068b9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:39.075410 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3fd8a97d-7939-41bb-91ca-c8010af068b9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:39.075829 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-3fd8a97d-7939-41bb-91ca-c8010af068b9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lazy-loading 'fault' on Instance uuid 40898498-b30e-4c04-bef4-fca5f87da4c0 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:00:39.120267 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3fd8a97d-7939-41bb-91ca-c8010af068b9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436adf49f3e24e03971017ea6dd33ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19b01b0af6c43feb357799d8ae948e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:39.129726 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3fd8a97d-7939-41bb-91ca-c8010af068b9 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 200 len: 1229 microversion: 2.1 time: 0.104447 Aug 26 16:00:39.132575 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 518/1043] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:39 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:39.423316 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-cfab6cef-c2d5-476b-afb5-22aaaabd393e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:39.426830 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-cfab6cef-c2d5-476b-afb5-22aaaabd393e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:39.434563 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cfab6cef-c2d5-476b-afb5-22aaaabd393e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:39.435305 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cfab6cef-c2d5-476b-afb5-22aaaabd393e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:39.435898 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cfab6cef-c2d5-476b-afb5-22aaaabd393e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:39.436802 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cfab6cef-c2d5-476b-afb5-22aaaabd393e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:39.437251 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cfab6cef-c2d5-476b-afb5-22aaaabd393e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:39.437670 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-cfab6cef-c2d5-476b-afb5-22aaaabd393e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:39.585395 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cfab6cef-c2d5-476b-afb5-22aaaabd393e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:39.595233 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cfab6cef-c2d5-476b-afb5-22aaaabd393e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:39.596689 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-cfab6cef-c2d5-476b-afb5-22aaaabd393e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:39.597885 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-cfab6cef-c2d5-476b-afb5-22aaaabd393e tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.179161 Aug 26 16:00:39.598446 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 526/1044] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:39 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:40.154235 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-64699057-2c6a-4e4f-8435-1d2c5a089aba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:40.154863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-64699057-2c6a-4e4f-8435-1d2c5a089aba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 40898498-b30e-4c04-bef4-fca5f87da4c0] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:40.162867 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64699057-2c6a-4e4f-8435-1d2c5a089aba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:40.163353 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64699057-2c6a-4e4f-8435-1d2c5a089aba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:40.163789 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64699057-2c6a-4e4f-8435-1d2c5a089aba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:40.164545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64699057-2c6a-4e4f-8435-1d2c5a089aba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:40.165587 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64699057-2c6a-4e4f-8435-1d2c5a089aba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:40.166015 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-64699057-2c6a-4e4f-8435-1d2c5a089aba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:40.181868 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-64699057-2c6a-4e4f-8435-1d2c5a089aba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] HTTP exception thrown: Instance 40898498-b30e-4c04-bef4-fca5f87da4c0 could not be found. Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-64699057-2c6a-4e4f-8435-1d2c5a089aba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Request method failure captured: Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 HTTP/1.1 Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOw0gxYdmgd_KC6T2ZoJoPeBSQ6xSwQ51ggBKd5aVfnrjnSWk0JklefJXHG9ahlE4M8RPaAlFGIl7_7J8XrqPa-v1c1e98cyQQ7UrHyOzzdeRhvgBVmIPFFpTmfAzqqWpnI7-sH_xS4ckOyOXl6MQDH96OkFe0FDbRSPxZuiKT1_D0s Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: d19b01b0af6c43feb357799d8ae948e1 Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-TestVolumeBootPattern-107255747 Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 16:00:40.183479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 16:00:40.185016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d19b01b0af6c43feb357799d8ae948e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d19b01b0af6c43feb357799d8ae948e1", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d19b01b0af6c43feb357799d8ae948e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d19b01b0af6c43feb357799d8ae948e1"}]}] Aug 26 16:00:40.185016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-TestVolumeBootPattern-107255747 Aug 26 16:00:40.185016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: d19b01b0af6c43feb357799d8ae948e1 Aug 26 16:00:40.185016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-TestVolumeBootPattern-107255747 Aug 26 16:00:40.185016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-TestVolumeBootPattern-107255747-project Aug 26 16:00:40.185016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 16:00:40.185016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 16:00:40.185016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 436adf49f3e24e03971017ea6dd33ac8 Aug 26 16:00:40.185016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-TestVolumeBootPattern-107255747-project Aug 26 16:00:40.185016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 16:00:40.185016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance 40898498-b30e-4c04-bef4-fca5f87da4c0 could not be found. Aug 26 16:00:40.185016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '40898498-b30e-4c04-bef4-fca5f87da4c0'} Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40898498-b30e-4c04-bef4-fca5f87da4c0 could not be found. Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:00:40.185821 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40898498-b30e-4c04-bef4-fca5f87da4c0 could not be found. Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40898498-b30e-4c04-bef4-fca5f87da4c0 could not be found. Aug 26 16:00:40.187118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:40.188468 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-64699057-2c6a-4e4f-8435-1d2c5a089aba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Returning 404 to user: Instance 40898498-b30e-4c04-bef4-fca5f87da4c0 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:00:40.188468 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-64699057-2c6a-4e4f-8435-1d2c5a089aba tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0" status: 404 len: 111 microversion: 2.1 time: 0.034765 Aug 26 16:00:40.188468 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 519/1045] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:40 2022] GET /compute/v2.1/servers/40898498-b30e-4c04-bef4-fca5f87da4c0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:00:40.622552 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-79c00591-f3e7-4f1f-96b4-94e5dc250796 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:40.623183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-79c00591-f3e7-4f1f-96b4-94e5dc250796 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:40.635638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-79c00591-f3e7-4f1f-96b4-94e5dc250796 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:40.636144 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-79c00591-f3e7-4f1f-96b4-94e5dc250796 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:40.636576 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-79c00591-f3e7-4f1f-96b4-94e5dc250796 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:40.637276 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-79c00591-f3e7-4f1f-96b4-94e5dc250796 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:40.637898 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-79c00591-f3e7-4f1f-96b4-94e5dc250796 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:40.638537 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-79c00591-f3e7-4f1f-96b4-94e5dc250796 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:40.926577 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b1184306-e4f1-409d-ac9c-a762d4bccb26 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:40.927708 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b1184306-e4f1-409d-ac9c-a762d4bccb26 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:40.935514 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b1184306-e4f1-409d-ac9c-a762d4bccb26 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:40.936240 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b1184306-e4f1-409d-ac9c-a762d4bccb26 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:40.937205 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b1184306-e4f1-409d-ac9c-a762d4bccb26 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:40.937321 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-79c00591-f3e7-4f1f-96b4-94e5dc250796 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:40.937989 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b1184306-e4f1-409d-ac9c-a762d4bccb26 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:40.938668 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b1184306-e4f1-409d-ac9c-a762d4bccb26 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:40.939101 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b1184306-e4f1-409d-ac9c-a762d4bccb26 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:40.947317 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-79c00591-f3e7-4f1f-96b4-94e5dc250796 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:40.949392 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-79c00591-f3e7-4f1f-96b4-94e5dc250796 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:40.952798 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-79c00591-f3e7-4f1f-96b4-94e5dc250796 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.332150 Aug 26 16:00:40.953458 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 527/1046] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:40 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-b1184306-e4f1-409d-ac9c-a762d4bccb26 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] HTTP exception thrown: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b1184306-e4f1-409d-ac9c-a762d4bccb26 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Request method failure captured: Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: DELETE /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 HTTP/1.1 Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOw0gxYdmgd_KC6T2ZoJoPeBSQ6xSwQ51ggBKd5aVfnrjnSWk0JklefJXHG9ahlE4M8RPaAlFGIl7_7J8XrqPa-v1c1e98cyQQ7UrHyOzzdeRhvgBVmIPFFpTmfAzqqWpnI7-sH_xS4ckOyOXl6MQDH96OkFe0FDbRSPxZuiKT1_D0s Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: d19b01b0af6c43feb357799d8ae948e1 Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-TestVolumeBootPattern-107255747 Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 16:00:40.964163 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 16:00:40.965736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d19b01b0af6c43feb357799d8ae948e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d19b01b0af6c43feb357799d8ae948e1", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d19b01b0af6c43feb357799d8ae948e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d19b01b0af6c43feb357799d8ae948e1"}]}] Aug 26 16:00:40.965736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-TestVolumeBootPattern-107255747 Aug 26 16:00:40.965736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: d19b01b0af6c43feb357799d8ae948e1 Aug 26 16:00:40.965736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-TestVolumeBootPattern-107255747 Aug 26 16:00:40.965736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-TestVolumeBootPattern-107255747-project Aug 26 16:00:40.965736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 16:00:40.965736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 16:00:40.965736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 436adf49f3e24e03971017ea6dd33ac8 Aug 26 16:00:40.965736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-TestVolumeBootPattern-107255747-project Aug 26 16:00:40.965736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 16:00:40.965736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. Aug 26 16:00:40.965736 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '669aaa3a-3cdf-4764-aa7f-38e9cc9e9894'} Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:00:40.966560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. Aug 26 16:00:40.967981 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:40.969501 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b1184306-e4f1-409d-ac9c-a762d4bccb26 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Returning 404 to user: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:00:40.969501 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-b1184306-e4f1-409d-ac9c-a762d4bccb26 tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "DELETE /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 404 len: 111 microversion: 2.1 time: 0.038758 Aug 26 16:00:40.969501 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 520/1047] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 16:00:40 2022] DELETE /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:00:40.978704 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-08d58026-ffb3-4f1e-a8c6-6d26d25e8e9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:40.979618 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-08d58026-ffb3-4f1e-a8c6-6d26d25e8e9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] [instance: 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:40.987461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-08d58026-ffb3-4f1e-a8c6-6d26d25e8e9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:40.988093 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-08d58026-ffb3-4f1e-a8c6-6d26d25e8e9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:40.988620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-08d58026-ffb3-4f1e-a8c6-6d26d25e8e9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:40.989336 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-08d58026-ffb3-4f1e-a8c6-6d26d25e8e9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:40.989857 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-08d58026-ffb3-4f1e-a8c6-6d26d25e8e9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:40.990349 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-08d58026-ffb3-4f1e-a8c6-6d26d25e8e9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:41.006464 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-08d58026-ffb3-4f1e-a8c6-6d26d25e8e9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] HTTP exception thrown: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-08d58026-ffb3-4f1e-a8c6-6d26d25e8e9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Request method failure captured: Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 HTTP/1.1 Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCOw0gxYdmgd_KC6T2ZoJoPeBSQ6xSwQ51ggBKd5aVfnrjnSWk0JklefJXHG9ahlE4M8RPaAlFGIl7_7J8XrqPa-v1c1e98cyQQ7UrHyOzzdeRhvgBVmIPFFpTmfAzqqWpnI7-sH_xS4ckOyOXl6MQDH96OkFe0FDbRSPxZuiKT1_D0s Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: d19b01b0af6c43feb357799d8ae948e1 Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-TestVolumeBootPattern-107255747 Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 16:00:41.008173 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 16:00:41.010440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d19b01b0af6c43feb357799d8ae948e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d19b01b0af6c43feb357799d8ae948e1", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d19b01b0af6c43feb357799d8ae948e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d19b01b0af6c43feb357799d8ae948e1"}]}] Aug 26 16:00:41.010440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-TestVolumeBootPattern-107255747 Aug 26 16:00:41.010440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: d19b01b0af6c43feb357799d8ae948e1 Aug 26 16:00:41.010440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-TestVolumeBootPattern-107255747 Aug 26 16:00:41.010440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-TestVolumeBootPattern-107255747-project Aug 26 16:00:41.010440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 16:00:41.010440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 16:00:41.010440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 436adf49f3e24e03971017ea6dd33ac8 Aug 26 16:00:41.010440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-TestVolumeBootPattern-107255747-project Aug 26 16:00:41.010440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 16:00:41.010440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. Aug 26 16:00:41.010440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '669aaa3a-3cdf-4764-aa7f-38e9cc9e9894'} Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:00:41.011379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. Aug 26 16:00:41.012980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:00:41.014393 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-08d58026-ffb3-4f1e-a8c6-6d26d25e8e9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Returning 404 to user: Instance 669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:00:41.014393 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-08d58026-ffb3-4f1e-a8c6-6d26d25e8e9b tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894" status: 404 len: 111 microversion: 2.1 time: 0.042484 Aug 26 16:00:41.014393 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 521/1048] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:40 2022] GET /compute/v2.1/servers/669aaa3a-3cdf-4764-aa7f-38e9cc9e9894 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 16:00:41.983227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-32bbd60d-e034-4bf6-8523-d0085a978b4b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:41.985291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-32bbd60d-e034-4bf6-8523-d0085a978b4b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:41.993257 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-32bbd60d-e034-4bf6-8523-d0085a978b4b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:41.998711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-32bbd60d-e034-4bf6-8523-d0085a978b4b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:41.998711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-32bbd60d-e034-4bf6-8523-d0085a978b4b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:41.998711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-32bbd60d-e034-4bf6-8523-d0085a978b4b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:41.998711 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-32bbd60d-e034-4bf6-8523-d0085a978b4b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:41.999104 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-32bbd60d-e034-4bf6-8523-d0085a978b4b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:42.146294 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-32bbd60d-e034-4bf6-8523-d0085a978b4b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:42.156612 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-32bbd60d-e034-4bf6-8523-d0085a978b4b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:42.158046 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-32bbd60d-e034-4bf6-8523-d0085a978b4b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:42.159220 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-32bbd60d-e034-4bf6-8523-d0085a978b4b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.180111 Aug 26 16:00:42.159768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 528/1049] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:41 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:42.618321 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-9b3dcf6d-c36e-40d5-ba1d-d04435d3fd0a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] Calling method '.version_select at 0x7fbd1e08b820>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:42.723366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-9b3dcf6d-c36e-40d5-ba1d-d04435d3fd0a tempest-TestVolumeBootPattern-107255747 tempest-TestVolumeBootPattern-107255747-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-764795854" status: 202 len: 0 microversion: 2.1 time: 0.110666 Aug 26 16:00:42.724259 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 522/1050] 10.222.0.98 () {58 vars in 1260 bytes} [Fri Aug 26 16:00:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-764795854 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:00:43.182475 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-3ab844f9-8cb7-486c-8847-1a6e2a760252 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:43.183096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-3ab844f9-8cb7-486c-8847-1a6e2a760252 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:43.194814 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3ab844f9-8cb7-486c-8847-1a6e2a760252 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:43.195366 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3ab844f9-8cb7-486c-8847-1a6e2a760252 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:43.195838 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3ab844f9-8cb7-486c-8847-1a6e2a760252 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:43.196856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3ab844f9-8cb7-486c-8847-1a6e2a760252 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:43.197315 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3ab844f9-8cb7-486c-8847-1a6e2a760252 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:43.197748 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-3ab844f9-8cb7-486c-8847-1a6e2a760252 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:43.379074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-3ab844f9-8cb7-486c-8847-1a6e2a760252 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:43.390300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-3ab844f9-8cb7-486c-8847-1a6e2a760252 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:43.392358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-3ab844f9-8cb7-486c-8847-1a6e2a760252 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:43.394063 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-3ab844f9-8cb7-486c-8847-1a6e2a760252 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.215597 Aug 26 16:00:43.396896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 529/1051] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:43 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:44.419247 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-6a420cf0-0163-4866-870d-cdd2147e3bcd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:44.419907 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-6a420cf0-0163-4866-870d-cdd2147e3bcd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:44.434632 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6a420cf0-0163-4866-870d-cdd2147e3bcd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:44.435895 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6a420cf0-0163-4866-870d-cdd2147e3bcd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:44.435895 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6a420cf0-0163-4866-870d-cdd2147e3bcd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:44.436440 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6a420cf0-0163-4866-870d-cdd2147e3bcd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:44.437044 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6a420cf0-0163-4866-870d-cdd2147e3bcd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:44.437479 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-6a420cf0-0163-4866-870d-cdd2147e3bcd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:44.473640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:44.757027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-6a420cf0-0163-4866-870d-cdd2147e3bcd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:44.777011 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-6a420cf0-0163-4866-870d-cdd2147e3bcd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:44.781537 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-6a420cf0-0163-4866-870d-cdd2147e3bcd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:44.784203 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-6a420cf0-0163-4866-870d-cdd2147e3bcd tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.369676 Aug 26 16:00:44.786411 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 523/1052] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:44 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:45.810013 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1e7fed86-ba12-485a-aabe-ec28e2b38f39 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:45.811532 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1e7fed86-ba12-485a-aabe-ec28e2b38f39 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:45.819971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1e7fed86-ba12-485a-aabe-ec28e2b38f39 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:45.820826 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1e7fed86-ba12-485a-aabe-ec28e2b38f39 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:45.821923 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1e7fed86-ba12-485a-aabe-ec28e2b38f39 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:45.823338 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1e7fed86-ba12-485a-aabe-ec28e2b38f39 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:45.824096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1e7fed86-ba12-485a-aabe-ec28e2b38f39 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:45.824814 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1e7fed86-ba12-485a-aabe-ec28e2b38f39 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:46.094827 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1e7fed86-ba12-485a-aabe-ec28e2b38f39 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:46.098811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:46.104435 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1e7fed86-ba12-485a-aabe-ec28e2b38f39 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:46.106026 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1e7fed86-ba12-485a-aabe-ec28e2b38f39 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:46.107227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1e7fed86-ba12-485a-aabe-ec28e2b38f39 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.302876 Aug 26 16:00:46.107795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 530/1053] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:45 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:47.131763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4a3cd93b-6ac4-4e60-87ca-412945325101 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:47.132548 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-4a3cd93b-6ac4-4e60-87ca-412945325101 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:47.142988 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4a3cd93b-6ac4-4e60-87ca-412945325101 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:47.143817 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4a3cd93b-6ac4-4e60-87ca-412945325101 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:47.144486 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4a3cd93b-6ac4-4e60-87ca-412945325101 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:47.147188 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4a3cd93b-6ac4-4e60-87ca-412945325101 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:47.147188 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4a3cd93b-6ac4-4e60-87ca-412945325101 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:47.147188 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4a3cd93b-6ac4-4e60-87ca-412945325101 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:47.396228 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4a3cd93b-6ac4-4e60-87ca-412945325101 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:47.409061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4a3cd93b-6ac4-4e60-87ca-412945325101 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:47.411362 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4a3cd93b-6ac4-4e60-87ca-412945325101 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:47.413585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4a3cd93b-6ac4-4e60-87ca-412945325101 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.286824 Aug 26 16:00:47.414941 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 524/1054] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:47 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:48.592538 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-830546be-c7fe-4fb1-8f73-043dd603ef12 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:48.592538 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-830546be-c7fe-4fb1-8f73-043dd603ef12 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:48.592538 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-830546be-c7fe-4fb1-8f73-043dd603ef12 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:48.592538 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-830546be-c7fe-4fb1-8f73-043dd603ef12 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:48.594910 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-830546be-c7fe-4fb1-8f73-043dd603ef12 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:48.594910 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-830546be-c7fe-4fb1-8f73-043dd603ef12 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:48.594910 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-830546be-c7fe-4fb1-8f73-043dd603ef12 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:48.594910 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-830546be-c7fe-4fb1-8f73-043dd603ef12 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:48.605423 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-830546be-c7fe-4fb1-8f73-043dd603ef12 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:48.611237 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-830546be-c7fe-4fb1-8f73-043dd603ef12 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:48.613082 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-830546be-c7fe-4fb1-8f73-043dd603ef12 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:48.615289 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-830546be-c7fe-4fb1-8f73-043dd603ef12 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.180737 Aug 26 16:00:48.616546 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 531/1055] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:48 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:49.646456 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-33c5aa0e-0c6d-4c1c-b3fe-817164a9c7fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:49.652403 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-33c5aa0e-0c6d-4c1c-b3fe-817164a9c7fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:49.655481 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-33c5aa0e-0c6d-4c1c-b3fe-817164a9c7fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:49.656699 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-33c5aa0e-0c6d-4c1c-b3fe-817164a9c7fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:49.657150 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-33c5aa0e-0c6d-4c1c-b3fe-817164a9c7fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:49.657904 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-33c5aa0e-0c6d-4c1c-b3fe-817164a9c7fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:49.658843 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-33c5aa0e-0c6d-4c1c-b3fe-817164a9c7fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:49.659297 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-33c5aa0e-0c6d-4c1c-b3fe-817164a9c7fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:49.938856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-33c5aa0e-0c6d-4c1c-b3fe-817164a9c7fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:49.947261 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-33c5aa0e-0c6d-4c1c-b3fe-817164a9c7fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:49.948730 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-33c5aa0e-0c6d-4c1c-b3fe-817164a9c7fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:49.949889 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-33c5aa0e-0c6d-4c1c-b3fe-817164a9c7fe tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.307890 Aug 26 16:00:49.950444 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 525/1056] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:49 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:50.974164 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7d11dd00-38b0-4c8b-b26c-f093867e39bc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:50.975022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7d11dd00-38b0-4c8b-b26c-f093867e39bc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:50.983810 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7d11dd00-38b0-4c8b-b26c-f093867e39bc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:50.984418 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7d11dd00-38b0-4c8b-b26c-f093867e39bc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:50.985107 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7d11dd00-38b0-4c8b-b26c-f093867e39bc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:50.986231 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7d11dd00-38b0-4c8b-b26c-f093867e39bc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:50.986808 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7d11dd00-38b0-4c8b-b26c-f093867e39bc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:50.987464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7d11dd00-38b0-4c8b-b26c-f093867e39bc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:51.138296 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7d11dd00-38b0-4c8b-b26c-f093867e39bc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:51.148762 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7d11dd00-38b0-4c8b-b26c-f093867e39bc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:51.150455 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7d11dd00-38b0-4c8b-b26c-f093867e39bc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:51.151725 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7d11dd00-38b0-4c8b-b26c-f093867e39bc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.181530 Aug 26 16:00:51.152572 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 532/1057] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:50 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:52.177316 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8c13ab78-e426-4388-b52b-71e01cbce872 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:52.177996 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-8c13ab78-e426-4388-b52b-71e01cbce872 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:52.185798 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8c13ab78-e426-4388-b52b-71e01cbce872 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:52.186388 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8c13ab78-e426-4388-b52b-71e01cbce872 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:52.186902 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8c13ab78-e426-4388-b52b-71e01cbce872 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:52.187709 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8c13ab78-e426-4388-b52b-71e01cbce872 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:52.188471 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8c13ab78-e426-4388-b52b-71e01cbce872 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:52.188972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8c13ab78-e426-4388-b52b-71e01cbce872 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:52.366155 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8c13ab78-e426-4388-b52b-71e01cbce872 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:52.376452 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8c13ab78-e426-4388-b52b-71e01cbce872 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:52.377908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8c13ab78-e426-4388-b52b-71e01cbce872 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:52.379092 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-8c13ab78-e426-4388-b52b-71e01cbce872 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.206424 Aug 26 16:00:52.379667 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 526/1058] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:52 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:53.406129 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-29fdf3e3-97cf-4b01-9284-338722820374 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:53.406675 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-29fdf3e3-97cf-4b01-9284-338722820374 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:53.414686 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-29fdf3e3-97cf-4b01-9284-338722820374 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:53.415166 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-29fdf3e3-97cf-4b01-9284-338722820374 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:53.415669 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-29fdf3e3-97cf-4b01-9284-338722820374 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:53.416407 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-29fdf3e3-97cf-4b01-9284-338722820374 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:53.416859 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-29fdf3e3-97cf-4b01-9284-338722820374 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:53.417286 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-29fdf3e3-97cf-4b01-9284-338722820374 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:53.560498 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-29fdf3e3-97cf-4b01-9284-338722820374 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:53.568681 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-29fdf3e3-97cf-4b01-9284-338722820374 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:53.570724 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-29fdf3e3-97cf-4b01-9284-338722820374 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:53.572189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-29fdf3e3-97cf-4b01-9284-338722820374 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.170265 Aug 26 16:00:53.576119 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 533/1059] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:53 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:54.596306 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-15813f8c-bfa5-4fe7-a4de-480b12223677 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:54.616537 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-15813f8c-bfa5-4fe7-a4de-480b12223677 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:54.631605 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15813f8c-bfa5-4fe7-a4de-480b12223677 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:54.632142 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15813f8c-bfa5-4fe7-a4de-480b12223677 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:54.632699 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15813f8c-bfa5-4fe7-a4de-480b12223677 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:54.634040 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15813f8c-bfa5-4fe7-a4de-480b12223677 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:54.634673 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15813f8c-bfa5-4fe7-a4de-480b12223677 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:54.635097 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15813f8c-bfa5-4fe7-a4de-480b12223677 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:54.799892 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-15813f8c-bfa5-4fe7-a4de-480b12223677 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:54.809430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-15813f8c-bfa5-4fe7-a4de-480b12223677 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:54.811202 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-15813f8c-bfa5-4fe7-a4de-480b12223677 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:54.812781 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-15813f8c-bfa5-4fe7-a4de-480b12223677 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.221071 Aug 26 16:00:54.813579 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 527/1060] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:54 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:55.838337 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-60fa08fb-806a-4d60-9029-43d139b9c58d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:55.839203 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-60fa08fb-806a-4d60-9029-43d139b9c58d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:55.847662 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-60fa08fb-806a-4d60-9029-43d139b9c58d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:55.848408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-60fa08fb-806a-4d60-9029-43d139b9c58d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:55.848943 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-60fa08fb-806a-4d60-9029-43d139b9c58d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:55.850021 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-60fa08fb-806a-4d60-9029-43d139b9c58d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:55.850622 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-60fa08fb-806a-4d60-9029-43d139b9c58d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:55.851148 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-60fa08fb-806a-4d60-9029-43d139b9c58d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:56.011083 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-60fa08fb-806a-4d60-9029-43d139b9c58d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:56.019391 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-60fa08fb-806a-4d60-9029-43d139b9c58d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:56.020978 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-60fa08fb-806a-4d60-9029-43d139b9c58d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:56.022234 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-60fa08fb-806a-4d60-9029-43d139b9c58d tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.188343 Aug 26 16:00:56.022887 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 534/1061] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:55 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:56.584428 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-e7245b13-961a-494a-8604-ee90c3b1261a req-32610c06-46f5-40ce-9788-57db3b103d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01966e1-92f0-493e-8ab3-83ac1156bc62", "name": "network-vif-plugged", "status": "completed", "tag": "63d32d8a-e638-4a51-aaf0-bb470afb21db"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:56.602013 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-e7245b13-961a-494a-8604-ee90c3b1261a req-32610c06-46f5-40ce-9788-57db3b103d3d service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:56.602490 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-e7245b13-961a-494a-8604-ee90c3b1261a req-32610c06-46f5-40ce-9788-57db3b103d3d service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:56.602971 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-e7245b13-961a-494a-8604-ee90c3b1261a req-32610c06-46f5-40ce-9788-57db3b103d3d service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:56.614885 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-e7245b13-961a-494a-8604-ee90c3b1261a req-32610c06-46f5-40ce-9788-57db3b103d3d service nova] Creating event network-vif-plugged:63d32d8a-e638-4a51-aaf0-bb470afb21db for instance c01966e1-92f0-493e-8ab3-83ac1156bc62 on hv-cinder-83124 Aug 26 16:00:56.621414 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-e7245b13-961a-494a-8604-ee90c3b1261a req-32610c06-46f5-40ce-9788-57db3b103d3d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043308 Aug 26 16:00:56.622435 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 528/1062] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:00:57.047531 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-313f7a32-e5d6-4e01-9ce6-812765616f9b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:57.048608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-313f7a32-e5d6-4e01-9ce6-812765616f9b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:57.056738 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-313f7a32-e5d6-4e01-9ce6-812765616f9b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:57.057218 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-313f7a32-e5d6-4e01-9ce6-812765616f9b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:57.057649 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-313f7a32-e5d6-4e01-9ce6-812765616f9b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:57.058348 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-313f7a32-e5d6-4e01-9ce6-812765616f9b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:57.058843 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-313f7a32-e5d6-4e01-9ce6-812765616f9b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:57.059590 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-313f7a32-e5d6-4e01-9ce6-812765616f9b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:57.222363 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-313f7a32-e5d6-4e01-9ce6-812765616f9b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:57.231241 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-313f7a32-e5d6-4e01-9ce6-812765616f9b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:57.232770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-313f7a32-e5d6-4e01-9ce6-812765616f9b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:57.234049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-313f7a32-e5d6-4e01-9ce6-812765616f9b tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.191471 Aug 26 16:00:57.234610 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 535/1063] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:57 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:58.257881 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-89a76bd5-05ab-4f02-bee9-baa4259147ad tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:58.258488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-89a76bd5-05ab-4f02-bee9-baa4259147ad tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:58.264970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89a76bd5-05ab-4f02-bee9-baa4259147ad tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:58.265460 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89a76bd5-05ab-4f02-bee9-baa4259147ad tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:58.265898 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89a76bd5-05ab-4f02-bee9-baa4259147ad tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:58.266620 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89a76bd5-05ab-4f02-bee9-baa4259147ad tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:58.267109 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89a76bd5-05ab-4f02-bee9-baa4259147ad tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:58.267496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-89a76bd5-05ab-4f02-bee9-baa4259147ad tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:58.410789 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-89a76bd5-05ab-4f02-bee9-baa4259147ad tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:58.419550 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-89a76bd5-05ab-4f02-bee9-baa4259147ad tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:58.421055 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-89a76bd5-05ab-4f02-bee9-baa4259147ad tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:58.422227 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-89a76bd5-05ab-4f02-bee9-baa4259147ad tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.168827 Aug 26 16:00:58.422823 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 529/1064] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:58 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:59.445218 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-2788b79e-6117-4b37-af8c-14ea3fd0319f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:59.445837 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-2788b79e-6117-4b37-af8c-14ea3fd0319f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:59.448380 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:59.453168 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2788b79e-6117-4b37-af8c-14ea3fd0319f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:59.453653 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2788b79e-6117-4b37-af8c-14ea3fd0319f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:59.454088 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2788b79e-6117-4b37-af8c-14ea3fd0319f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:59.454790 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2788b79e-6117-4b37-af8c-14ea3fd0319f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:59.455240 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2788b79e-6117-4b37-af8c-14ea3fd0319f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:59.455663 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2788b79e-6117-4b37-af8c-14ea3fd0319f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:59.592083 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2788b79e-6117-4b37-af8c-14ea3fd0319f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:59.600318 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2788b79e-6117-4b37-af8c-14ea3fd0319f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:59.601751 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-2788b79e-6117-4b37-af8c-14ea3fd0319f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:59.602916 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-2788b79e-6117-4b37-af8c-14ea3fd0319f tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.161690 Aug 26 16:00:59.603464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 536/1065] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:59 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:00.626720 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-9a35f75a-970b-4c75-96c7-5258c3f57839 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:00.629155 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-9a35f75a-970b-4c75-96c7-5258c3f57839 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:00.634078 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a35f75a-970b-4c75-96c7-5258c3f57839 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:00.634548 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a35f75a-970b-4c75-96c7-5258c3f57839 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:00.634972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a35f75a-970b-4c75-96c7-5258c3f57839 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:00.635656 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a35f75a-970b-4c75-96c7-5258c3f57839 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:00.636124 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a35f75a-970b-4c75-96c7-5258c3f57839 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:00.636539 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9a35f75a-970b-4c75-96c7-5258c3f57839 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:00.779707 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-9a35f75a-970b-4c75-96c7-5258c3f57839 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:00.790062 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-9a35f75a-970b-4c75-96c7-5258c3f57839 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:00.791856 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-9a35f75a-970b-4c75-96c7-5258c3f57839 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:00.793200 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-9a35f75a-970b-4c75-96c7-5258c3f57839 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.170430 Aug 26 16:01:00.793758 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 530/1066] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:00 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:01.817117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9d5e7f14-5edd-4a76-8999-3b77ec8fd7f8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:01.817747 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9d5e7f14-5edd-4a76-8999-3b77ec8fd7f8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:01.825142 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9d5e7f14-5edd-4a76-8999-3b77ec8fd7f8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:01.825618 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9d5e7f14-5edd-4a76-8999-3b77ec8fd7f8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:01.826046 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9d5e7f14-5edd-4a76-8999-3b77ec8fd7f8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:01.826760 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9d5e7f14-5edd-4a76-8999-3b77ec8fd7f8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:01.827203 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9d5e7f14-5edd-4a76-8999-3b77ec8fd7f8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:01.827638 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9d5e7f14-5edd-4a76-8999-3b77ec8fd7f8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:01.958907 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9d5e7f14-5edd-4a76-8999-3b77ec8fd7f8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:01.967913 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9d5e7f14-5edd-4a76-8999-3b77ec8fd7f8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:01.974075 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-9d5e7f14-5edd-4a76-8999-3b77ec8fd7f8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:01.974075 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9d5e7f14-5edd-4a76-8999-3b77ec8fd7f8 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1731 microversion: 2.20 time: 0.157361 Aug 26 16:01:01.974075 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 537/1067] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:01 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:02.994672 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0094e967-b159-4316-bd00-4cdf179c159c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:02.995269 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0094e967-b159-4316-bd00-4cdf179c159c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:02.997729 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:03.002410 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0094e967-b159-4316-bd00-4cdf179c159c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:03.002888 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0094e967-b159-4316-bd00-4cdf179c159c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:03.003323 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0094e967-b159-4316-bd00-4cdf179c159c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:03.004056 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0094e967-b159-4316-bd00-4cdf179c159c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:03.004505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0094e967-b159-4316-bd00-4cdf179c159c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:03.004928 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0094e967-b159-4316-bd00-4cdf179c159c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:03.135629 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0094e967-b159-4316-bd00-4cdf179c159c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:03.144058 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0094e967-b159-4316-bd00-4cdf179c159c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:03.145518 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0094e967-b159-4316-bd00-4cdf179c159c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:03.146711 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0094e967-b159-4316-bd00-4cdf179c159c tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1718 microversion: 2.20 time: 0.156685 Aug 26 16:01:03.147276 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 531/1068] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:02 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:32.987184 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-23ad1c48-e4c5-47c4-ad0a-600253bcd403 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:32.989450 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-23ad1c48-e4c5-47c4-ad0a-600253bcd403 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:32.991646 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=3 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:32.992336 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=42 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:32.997046 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-23ad1c48-e4c5-47c4-ad0a-600253bcd403 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:32.997530 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-23ad1c48-e4c5-47c4-ad0a-600253bcd403 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:32.997970 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-23ad1c48-e4c5-47c4-ad0a-600253bcd403 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:32.998669 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-23ad1c48-e4c5-47c4-ad0a-600253bcd403 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:32.999123 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-23ad1c48-e4c5-47c4-ad0a-600253bcd403 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:32.999551 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-23ad1c48-e4c5-47c4-ad0a-600253bcd403 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:33.030634 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-23ad1c48-e4c5-47c4-ad0a-600253bcd403 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047466 Aug 26 16:01:33.031189 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 538/1069] 10.222.0.98 () {60 vars in 1343 bytes} [Fri Aug 26 16:01:32 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:33.094392 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-39acc2a6-3bf0-4130-99b8-e67309b5b172 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:33.094992 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-39acc2a6-3bf0-4130-99b8-e67309b5b172 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:33.097168 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:33.097850 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=47 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:33.102827 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-39acc2a6-3bf0-4130-99b8-e67309b5b172 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:33.106183 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-39acc2a6-3bf0-4130-99b8-e67309b5b172 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:33.106183 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-39acc2a6-3bf0-4130-99b8-e67309b5b172 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:33.106183 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-39acc2a6-3bf0-4130-99b8-e67309b5b172 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:33.106183 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-39acc2a6-3bf0-4130-99b8-e67309b5b172 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:33.106579 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-39acc2a6-3bf0-4130-99b8-e67309b5b172 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:33.134797 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-39acc2a6-3bf0-4130-99b8-e67309b5b172 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Going to try to terminate instance {{(pid=127698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:01:33.446531 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-39acc2a6-3bf0-4130-99b8-e67309b5b172 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 204 len: 0 microversion: 2.20 time: 0.355467 Aug 26 16:01:33.447316 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 532/1070] 10.222.0.98 () {60 vars in 1280 bytes} [Fri Aug 26 16:01:33 2022] DELETE /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 26 16:01:33.456206 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7b2cc5a6-76e7-4f80-9fe2-da5491f36309 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:33.456820 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7b2cc5a6-76e7-4f80-9fe2-da5491f36309 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:33.464334 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7b2cc5a6-76e7-4f80-9fe2-da5491f36309 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:33.464817 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7b2cc5a6-76e7-4f80-9fe2-da5491f36309 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:33.465255 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7b2cc5a6-76e7-4f80-9fe2-da5491f36309 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:33.465961 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7b2cc5a6-76e7-4f80-9fe2-da5491f36309 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:33.466415 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7b2cc5a6-76e7-4f80-9fe2-da5491f36309 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:33.466843 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7b2cc5a6-76e7-4f80-9fe2-da5491f36309 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:33.602388 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7b2cc5a6-76e7-4f80-9fe2-da5491f36309 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:33.610572 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7b2cc5a6-76e7-4f80-9fe2-da5491f36309 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:33.621586 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7b2cc5a6-76e7-4f80-9fe2-da5491f36309 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:33.621586 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7b2cc5a6-76e7-4f80-9fe2-da5491f36309 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1724 microversion: 2.20 time: 0.161628 Aug 26 16:01:33.621586 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 539/1071] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:33 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:34.638008 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-d9ac00cf-1910-46e8-8d54-11f913368566 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:34.638764 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-d9ac00cf-1910-46e8-8d54-11f913368566 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:34.646120 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d9ac00cf-1910-46e8-8d54-11f913368566 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:34.646614 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d9ac00cf-1910-46e8-8d54-11f913368566 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:34.647055 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d9ac00cf-1910-46e8-8d54-11f913368566 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:34.647755 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d9ac00cf-1910-46e8-8d54-11f913368566 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:34.648237 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d9ac00cf-1910-46e8-8d54-11f913368566 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:34.648664 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-d9ac00cf-1910-46e8-8d54-11f913368566 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:34.784196 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d9ac00cf-1910-46e8-8d54-11f913368566 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:34.794011 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d9ac00cf-1910-46e8-8d54-11f913368566 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:34.795554 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-d9ac00cf-1910-46e8-8d54-11f913368566 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:34.796860 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-d9ac00cf-1910-46e8-8d54-11f913368566 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1724 microversion: 2.20 time: 0.163108 Aug 26 16:01:34.797606 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 533/1072] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:34 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:35.822219 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-d3463079-7319-4fc1-b78a-24c507e3a9fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:35.822827 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-d3463079-7319-4fc1-b78a-24c507e3a9fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:35.829743 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d3463079-7319-4fc1-b78a-24c507e3a9fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:35.830227 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d3463079-7319-4fc1-b78a-24c507e3a9fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:35.830664 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d3463079-7319-4fc1-b78a-24c507e3a9fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:35.831356 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d3463079-7319-4fc1-b78a-24c507e3a9fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:35.832211 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d3463079-7319-4fc1-b78a-24c507e3a9fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:35.832676 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-d3463079-7319-4fc1-b78a-24c507e3a9fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:35.899153 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d3463079-7319-4fc1-b78a-24c507e3a9fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:35.906892 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d3463079-7319-4fc1-b78a-24c507e3a9fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:35.908365 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-d3463079-7319-4fc1-b78a-24c507e3a9fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:35.909533 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-d3463079-7319-4fc1-b78a-24c507e3a9fc tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1656 microversion: 2.20 time: 0.092186 Aug 26 16:01:35.910092 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 540/1073] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:35 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1656 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:36.050248 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-28709eba-4d3c-4b68-b621-4de6bdc80dde req-b1ca9670-2fe9-4346-b05e-a51081883fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01966e1-92f0-493e-8ab3-83ac1156bc62", "name": "network-vif-deleted", "tag": "63d32d8a-e638-4a51-aaf0-bb470afb21db"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:36.060667 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-28709eba-4d3c-4b68-b621-4de6bdc80dde req-b1ca9670-2fe9-4346-b05e-a51081883fbf service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:36.065380 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-28709eba-4d3c-4b68-b621-4de6bdc80dde req-b1ca9670-2fe9-4346-b05e-a51081883fbf service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:36.065380 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-28709eba-4d3c-4b68-b621-4de6bdc80dde req-b1ca9670-2fe9-4346-b05e-a51081883fbf service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:36.074520 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-28709eba-4d3c-4b68-b621-4de6bdc80dde req-b1ca9670-2fe9-4346-b05e-a51081883fbf service nova] Creating event network-vif-deleted:63d32d8a-e638-4a51-aaf0-bb470afb21db for instance c01966e1-92f0-493e-8ab3-83ac1156bc62 on hv-cinder-83124 Aug 26 16:01:36.080021 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-28709eba-4d3c-4b68-b621-4de6bdc80dde req-b1ca9670-2fe9-4346-b05e-a51081883fbf service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033743 Aug 26 16:01:36.080962 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 534/1074] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:01:36.933538 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:36.934474 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:36.941347 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:36.942106 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:36.942737 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:36.944430 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:36.944896 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:36.945327 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:36.979277 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:36.979794 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:36.981264 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:36.981264 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lazy-loading 'fault' on Instance uuid c01966e1-92f0-493e-8ab3-83ac1156bc62 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:01:37.025967 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:37.034489 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:37.035977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91966686fa7f4c5bb326cdb1e2abc1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b0a72955244448954be539f99435e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:37.037176 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7a935481-0982-46d7-96e3-5f929a874d19 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 200 len: 1371 microversion: 2.20 time: 0.107636 Aug 26 16:01:37.037943 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 541/1075] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:36 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:38.060797 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3ab62262-9efc-4297-b775-c296a04fd171 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:38.061499 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3ab62262-9efc-4297-b775-c296a04fd171 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:38.069365 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ab62262-9efc-4297-b775-c296a04fd171 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:38.069849 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ab62262-9efc-4297-b775-c296a04fd171 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:38.070284 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ab62262-9efc-4297-b775-c296a04fd171 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:38.071249 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ab62262-9efc-4297-b775-c296a04fd171 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:38.071902 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ab62262-9efc-4297-b775-c296a04fd171 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:38.072330 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ab62262-9efc-4297-b775-c296a04fd171 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:38.085961 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-3ab62262-9efc-4297-b775-c296a04fd171 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] HTTP exception thrown: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3ab62262-9efc-4297-b775-c296a04fd171 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Request method failure captured: Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 HTTP/1.1 Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCO0WO56w3e2qQBQDtdEo3ypvjfFKIpJicHSFJqh83HzgPhKcP4RW100zb8TxjgOJp3rGMgIC_qQM6oLS6wu7C9kTmKZDB1La98_dS7rpr-W2bu3jMynEsO1qqaUbIeCw65VZ8wzv6qQarC7qNs0nFVXMJMvKky3NcO1qTTM-NqoJxls Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: 10b0a72955244448954be539f99435e9 Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 16:01:38.087626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 16:01:38.089511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/10b0a72955244448954be539f99435e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_10b0a72955244448954be539f99435e9", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/10b0a72955244448954be539f99435e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/10b0a72955244448954be539f99435e9"}]}] Aug 26 16:01:38.089511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 16:01:38.089511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: 10b0a72955244448954be539f99435e9 Aug 26 16:01:38.089511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 16:01:38.089511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-AttachVolumeShelveTestJSON-1136984052-project Aug 26 16:01:38.089511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 16:01:38.089511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 16:01:38.089511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 91966686fa7f4c5bb326cdb1e2abc1d9 Aug 26 16:01:38.089511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1136984052-project Aug 26 16:01:38.089511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 16:01:38.089511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. Aug 26 16:01:38.089511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': 'c01966e1-92f0-493e-8ab3-83ac1156bc62'} Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:01:38.090513 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. Aug 26 16:01:38.092191 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:01:38.093590 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3ab62262-9efc-4297-b775-c296a04fd171 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Returning 404 to user: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:01:38.093590 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3ab62262-9efc-4297-b775-c296a04fd171 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 404 len: 111 microversion: 2.20 time: 0.032684 Aug 26 16:01:38.093590 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 535/1076] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:38 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 16:01:38.098249 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e03f3adb-447d-4cb3-8e0a-721281242c63 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '.version_select at 0x7fbd21b86040>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:38.178634 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e03f3adb-447d-4cb3-8e0a-721281242c63 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090401074" status: 204 len: 0 microversion: 2.20 time: 0.084310 Aug 26 16:01:38.179224 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 542/1077] 10.222.0.98 () {60 vars in 1262 bytes} [Fri Aug 26 16:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090401074 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 16:01:40.352147 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e2f7b09d-3dbb-432c-b54d-ce9add4ae2e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:40.352651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-e2f7b09d-3dbb-432c-b54d-ce9add4ae2e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:40.358961 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e2f7b09d-3dbb-432c-b54d-ce9add4ae2e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:40.359445 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e2f7b09d-3dbb-432c-b54d-ce9add4ae2e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:40.359902 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e2f7b09d-3dbb-432c-b54d-ce9add4ae2e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:40.360607 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e2f7b09d-3dbb-432c-b54d-ce9add4ae2e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:40.361058 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e2f7b09d-3dbb-432c-b54d-ce9add4ae2e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:40.361478 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-e2f7b09d-3dbb-432c-b54d-ce9add4ae2e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:40.374722 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-e2f7b09d-3dbb-432c-b54d-ce9add4ae2e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] HTTP exception thrown: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e2f7b09d-3dbb-432c-b54d-ce9add4ae2e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Request method failure captured: Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: DELETE /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 HTTP/1.1 Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCO0WO56w3e2qQBQDtdEo3ypvjfFKIpJicHSFJqh83HzgPhKcP4RW100zb8TxjgOJp3rGMgIC_qQM6oLS6wu7C9kTmKZDB1La98_dS7rpr-W2bu3jMynEsO1qqaUbIeCw65VZ8wzv6qQarC7qNs0nFVXMJMvKky3NcO1qTTM-NqoJxls Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: 10b0a72955244448954be539f99435e9 Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 16:01:40.377184 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 16:01:40.378953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/10b0a72955244448954be539f99435e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_10b0a72955244448954be539f99435e9", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/10b0a72955244448954be539f99435e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/10b0a72955244448954be539f99435e9"}]}] Aug 26 16:01:40.378953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 16:01:40.378953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: 10b0a72955244448954be539f99435e9 Aug 26 16:01:40.378953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 16:01:40.378953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-AttachVolumeShelveTestJSON-1136984052-project Aug 26 16:01:40.378953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 16:01:40.378953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 16:01:40.378953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 91966686fa7f4c5bb326cdb1e2abc1d9 Aug 26 16:01:40.378953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1136984052-project Aug 26 16:01:40.378953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 16:01:40.378953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. Aug 26 16:01:40.378953 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': 'c01966e1-92f0-493e-8ab3-83ac1156bc62'} Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:01:40.380026 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. Aug 26 16:01:40.381573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:01:40.383113 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-e2f7b09d-3dbb-432c-b54d-ce9add4ae2e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Returning 404 to user: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:01:40.383113 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-e2f7b09d-3dbb-432c-b54d-ce9add4ae2e6 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 404 len: 111 microversion: 2.20 time: 0.030075 Aug 26 16:01:40.383113 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 536/1078] 10.222.0.98 () {60 vars in 1280 bytes} [Fri Aug 26 16:01:40 2022] DELETE /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 16:01:40.386350 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-eee4f811-b8bb-4fc0-b101-5c3a6567807a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:40.386960 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-eee4f811-b8bb-4fc0-b101-5c3a6567807a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: c01966e1-92f0-493e-8ab3-83ac1156bc62] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:40.393557 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-eee4f811-b8bb-4fc0-b101-5c3a6567807a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:40.394039 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-eee4f811-b8bb-4fc0-b101-5c3a6567807a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:40.394476 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-eee4f811-b8bb-4fc0-b101-5c3a6567807a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:40.395171 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-eee4f811-b8bb-4fc0-b101-5c3a6567807a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:40.395622 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-eee4f811-b8bb-4fc0-b101-5c3a6567807a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:40.396585 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-eee4f811-b8bb-4fc0-b101-5c3a6567807a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:40.410707 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-eee4f811-b8bb-4fc0-b101-5c3a6567807a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] HTTP exception thrown: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-eee4f811-b8bb-4fc0-b101-5c3a6567807a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Request method failure captured: Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 HTTP/1.1 Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCO0WO56w3e2qQBQDtdEo3ypvjfFKIpJicHSFJqh83HzgPhKcP4RW100zb8TxjgOJp3rGMgIC_qQM6oLS6wu7C9kTmKZDB1La98_dS7rpr-W2bu3jMynEsO1qqaUbIeCw65VZ8wzv6qQarC7qNs0nFVXMJMvKky3NcO1qTTM-NqoJxls Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: 10b0a72955244448954be539f99435e9 Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 16:01:40.412979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 16:01:40.414710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/10b0a72955244448954be539f99435e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_10b0a72955244448954be539f99435e9", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/10b0a72955244448954be539f99435e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/10b0a72955244448954be539f99435e9"}]}] Aug 26 16:01:40.414710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 16:01:40.414710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: 10b0a72955244448954be539f99435e9 Aug 26 16:01:40.414710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 16:01:40.414710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-AttachVolumeShelveTestJSON-1136984052-project Aug 26 16:01:40.414710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 16:01:40.414710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 16:01:40.414710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 91966686fa7f4c5bb326cdb1e2abc1d9 Aug 26 16:01:40.414710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1136984052-project Aug 26 16:01:40.414710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 16:01:40.414710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. Aug 26 16:01:40.414710 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': 'c01966e1-92f0-493e-8ab3-83ac1156bc62'} Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:01:40.415701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. Aug 26 16:01:40.417362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:01:40.418894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-eee4f811-b8bb-4fc0-b101-5c3a6567807a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Returning 404 to user: Instance c01966e1-92f0-493e-8ab3-83ac1156bc62 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:01:40.418894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-eee4f811-b8bb-4fc0-b101-5c3a6567807a tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62" status: 404 len: 111 microversion: 2.20 time: 0.032048 Aug 26 16:01:40.418894 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 543/1079] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:40 2022] GET /compute/v2.1/servers/c01966e1-92f0-493e-8ab3-83ac1156bc62 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 26 16:01:41.766424 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-06267f43-c90b-4bc4-90fa-24424b5c2092 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:41.766925 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-06267f43-c90b-4bc4-90fa-24424b5c2092 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:41.773425 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-06267f43-c90b-4bc4-90fa-24424b5c2092 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:41.773906 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-06267f43-c90b-4bc4-90fa-24424b5c2092 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:41.774342 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-06267f43-c90b-4bc4-90fa-24424b5c2092 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:41.775045 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-06267f43-c90b-4bc4-90fa-24424b5c2092 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:41.775495 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-06267f43-c90b-4bc4-90fa-24424b5c2092 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:41.775946 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-06267f43-c90b-4bc4-90fa-24424b5c2092 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:41.789944 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-06267f43-c90b-4bc4-90fa-24424b5c2092 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] HTTP exception thrown: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-06267f43-c90b-4bc4-90fa-24424b5c2092 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Request method failure captured: Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: DELETE /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 HTTP/1.1 Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCO0WO56w3e2qQBQDtdEo3ypvjfFKIpJicHSFJqh83HzgPhKcP4RW100zb8TxjgOJp3rGMgIC_qQM6oLS6wu7C9kTmKZDB1La98_dS7rpr-W2bu3jMynEsO1qqaUbIeCw65VZ8wzv6qQarC7qNs0nFVXMJMvKky3NcO1qTTM-NqoJxls Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: 10b0a72955244448954be539f99435e9 Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 16:01:41.791544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 16:01:41.793366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/10b0a72955244448954be539f99435e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_10b0a72955244448954be539f99435e9", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/10b0a72955244448954be539f99435e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/10b0a72955244448954be539f99435e9"}]}] Aug 26 16:01:41.793366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 16:01:41.793366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: 10b0a72955244448954be539f99435e9 Aug 26 16:01:41.793366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 16:01:41.793366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-AttachVolumeShelveTestJSON-1136984052-project Aug 26 16:01:41.793366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 16:01:41.793366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 16:01:41.793366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 91966686fa7f4c5bb326cdb1e2abc1d9 Aug 26 16:01:41.793366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1136984052-project Aug 26 16:01:41.793366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 16:01:41.793366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. Aug 26 16:01:41.793366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': '9c6825d4-cc4d-4688-9532-01a6cee66ea2'} Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:01:41.794314 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. Aug 26 16:01:41.795822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:01:41.797723 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-06267f43-c90b-4bc4-90fa-24424b5c2092 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Returning 404 to user: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:01:41.797723 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-06267f43-c90b-4bc4-90fa-24424b5c2092 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 404 len: 111 microversion: 2.20 time: 0.030444 Aug 26 16:01:41.797723 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 537/1080] 10.222.0.98 () {60 vars in 1280 bytes} [Fri Aug 26 16:01:41 2022] DELETE /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 16:01:41.801752 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-72b5ccef-a5d6-4a78-9205-6b85faf1f298 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:41.802869 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-72b5ccef-a5d6-4a78-9205-6b85faf1f298 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] [instance: 9c6825d4-cc4d-4688-9532-01a6cee66ea2] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:41.809501 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-72b5ccef-a5d6-4a78-9205-6b85faf1f298 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:41.809979 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-72b5ccef-a5d6-4a78-9205-6b85faf1f298 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:41.810414 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-72b5ccef-a5d6-4a78-9205-6b85faf1f298 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:41.811117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-72b5ccef-a5d6-4a78-9205-6b85faf1f298 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:41.811572 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-72b5ccef-a5d6-4a78-9205-6b85faf1f298 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:41.812045 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-72b5ccef-a5d6-4a78-9205-6b85faf1f298 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:41.826453 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-72b5ccef-a5d6-4a78-9205-6b85faf1f298 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] HTTP exception thrown: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-72b5ccef-a5d6-4a78-9205-6b85faf1f298 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Request method failure captured: Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 HTTP/1.1 Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCO0WO56w3e2qQBQDtdEo3ypvjfFKIpJicHSFJqh83HzgPhKcP4RW100zb8TxjgOJp3rGMgIC_qQM6oLS6wu7C9kTmKZDB1La98_dS7rpr-W2bu3jMynEsO1qqaUbIeCw65VZ8wzv6qQarC7qNs0nFVXMJMvKky3NcO1qTTM-NqoJxls Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: 10b0a72955244448954be539f99435e9 Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 16:01:41.828027 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 16:01:41.829825 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/10b0a72955244448954be539f99435e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_10b0a72955244448954be539f99435e9", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/10b0a72955244448954be539f99435e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/10b0a72955244448954be539f99435e9"}]}] Aug 26 16:01:41.829825 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 16:01:41.829825 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: 10b0a72955244448954be539f99435e9 Aug 26 16:01:41.829825 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1136984052 Aug 26 16:01:41.829825 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-AttachVolumeShelveTestJSON-1136984052-project Aug 26 16:01:41.829825 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 16:01:41.829825 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 16:01:41.829825 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 91966686fa7f4c5bb326cdb1e2abc1d9 Aug 26 16:01:41.829825 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1136984052-project Aug 26 16:01:41.829825 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 16:01:41.829825 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. Aug 26 16:01:41.829825 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '9c6825d4-cc4d-4688-9532-01a6cee66ea2'} Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:01:41.830844 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. Aug 26 16:01:41.832410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:01:41.833823 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-72b5ccef-a5d6-4a78-9205-6b85faf1f298 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] Returning 404 to user: Instance 9c6825d4-cc4d-4688-9532-01a6cee66ea2 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:01:41.833823 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-72b5ccef-a5d6-4a78-9205-6b85faf1f298 tempest-AttachVolumeShelveTestJSON-1136984052 tempest-AttachVolumeShelveTestJSON-1136984052-project] 10.222.0.98 "GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2" status: 404 len: 111 microversion: 2.20 time: 0.031578 Aug 26 16:01:41.833823 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 544/1081] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:41 2022] GET /compute/v2.1/servers/9c6825d4-cc4d-4688-9532-01a6cee66ea2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 16:02:05.938533 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-716684930", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "networks": [{"uuid": "7a2395dc-a7e7-47d2-a8f1-732bfc909be1"}]}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:05.948128 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:05.948798 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:06.009602 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.network.neutron [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] validate_networks() for [('7a2395dc-a7e7-47d2-a8f1-732bfc909be1', None, None, None, None, None)] {{(pid=127698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 16:02:06.453871 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Flavor limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 16:02:06.454320 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Image limits 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 16:02:06.454794 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Flavor pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 16:02:06.455201 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Image pref 0:0:0 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 16:02:06.455616 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.virt.hardware [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 16:02:06.465739 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:06.466219 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:06.466650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:06.467376 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:06.467827 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:06.468279 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:06.486095 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Getting quotas for project d4aca222b23d447d84c26967902508ea. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:02:06.496484 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Getting quotas for user 0df9431cefb742cc980351e7f8df8950 and project d4aca222b23d447d84c26967902508ea. Resources: {'ram', 'cores', 'instances'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:02:06.502488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Going to run 1 instances... {{(pid=127698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 16:02:06.504909 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 16:02:06.673949 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [f907872e-bccc-44d0-b827-e59526c7934a] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 26 16:02:07.680903 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO oslo.messaging._drivers.impl_rabbit [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [f907872e-bccc-44d0-b827-e59526c7934a] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 50706. Aug 26 16:02:07.685671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-68887ecb-1f57-41c4-9f68-3073c53668a0 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.751063 Aug 26 16:02:07.686321 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 538/1082] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 16:02:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 16:02:07.697938 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-367ffe1b-80e5-47a1-9f6e-79ee430c53a2 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:07.698579 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-367ffe1b-80e5-47a1-9f6e-79ee430c53a2 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:07.701183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:07.701984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=30 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:07.775137 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-367ffe1b-80e5-47a1-9f6e-79ee430c53a2 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:07.788117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-367ffe1b-80e5-47a1-9f6e-79ee430c53a2 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1213 microversion: 2.1 time: 0.094254 Aug 26 16:02:07.794630 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 545/1083] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:07 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:08.810414 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-bd03aae1-f6d4-4b04-9691-f8f34c47abb8 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:08.811015 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-bd03aae1-f6d4-4b04-9691-f8f34c47abb8 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:08.866822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-bd03aae1-f6d4-4b04-9691-f8f34c47abb8 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:08.873796 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-bd03aae1-f6d4-4b04-9691-f8f34c47abb8 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1213 microversion: 2.1 time: 0.068007 Aug 26 16:02:08.888450 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 539/1084] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:08 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:09.896065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-fdd16282-0b4e-4504-b30a-becd4a333a37 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:09.896625 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-fdd16282-0b4e-4504-b30a-becd4a333a37 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:09.903338 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fdd16282-0b4e-4504-b30a-becd4a333a37 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:09.905902 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fdd16282-0b4e-4504-b30a-becd4a333a37 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:09.905902 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fdd16282-0b4e-4504-b30a-becd4a333a37 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:09.905902 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fdd16282-0b4e-4504-b30a-becd4a333a37 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:09.905902 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fdd16282-0b4e-4504-b30a-becd4a333a37 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:09.906300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fdd16282-0b4e-4504-b30a-becd4a333a37 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:09.974866 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-fdd16282-0b4e-4504-b30a-becd4a333a37 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:09.983538 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-fdd16282-0b4e-4504-b30a-becd4a333a37 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1265 microversion: 2.1 time: 0.091947 Aug 26 16:02:09.984337 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 546/1085] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:09 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:11.006065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ec7acb2f-4220-4847-b4b0-782aaf2fd1f2 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:11.006723 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ec7acb2f-4220-4847-b4b0-782aaf2fd1f2 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:11.013343 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ec7acb2f-4220-4847-b4b0-782aaf2fd1f2 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:11.013834 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ec7acb2f-4220-4847-b4b0-782aaf2fd1f2 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:11.014267 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ec7acb2f-4220-4847-b4b0-782aaf2fd1f2 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:11.014970 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ec7acb2f-4220-4847-b4b0-782aaf2fd1f2 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:11.015422 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ec7acb2f-4220-4847-b4b0-782aaf2fd1f2 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:11.015846 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ec7acb2f-4220-4847-b4b0-782aaf2fd1f2 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:11.087969 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ec7acb2f-4220-4847-b4b0-782aaf2fd1f2 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:11.095847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ec7acb2f-4220-4847-b4b0-782aaf2fd1f2 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1271 microversion: 2.1 time: 0.093702 Aug 26 16:02:11.098311 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 540/1086] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:11 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:12.117771 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-18f9e210-1e6b-4935-8370-5ef8acbefb7d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:12.118395 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-18f9e210-1e6b-4935-8370-5ef8acbefb7d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:12.124778 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18f9e210-1e6b-4935-8370-5ef8acbefb7d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:12.125263 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18f9e210-1e6b-4935-8370-5ef8acbefb7d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:12.125706 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18f9e210-1e6b-4935-8370-5ef8acbefb7d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:12.126492 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18f9e210-1e6b-4935-8370-5ef8acbefb7d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:12.126954 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18f9e210-1e6b-4935-8370-5ef8acbefb7d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:12.127363 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-18f9e210-1e6b-4935-8370-5ef8acbefb7d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:12.228286 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-318ffced-4073-48fe-8c4b-cf0c01d41876 req-86253733-eaa5-403d-995a-d43444be1438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16e1c2c-f691-43e9-b9d9-964c2ab7d943", "tag": "d1a107ff-cbb3-408c-8fc9-29fa2dcc1661"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:12.240642 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-318ffced-4073-48fe-8c4b-cf0c01d41876 req-86253733-eaa5-403d-995a-d43444be1438 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:12.241220 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-318ffced-4073-48fe-8c4b-cf0c01d41876 req-86253733-eaa5-403d-995a-d43444be1438 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:12.241928 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-318ffced-4073-48fe-8c4b-cf0c01d41876 req-86253733-eaa5-403d-995a-d43444be1438 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:12.254473 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-318ffced-4073-48fe-8c4b-cf0c01d41876 req-86253733-eaa5-403d-995a-d43444be1438 service nova] Creating event network-changed:d1a107ff-cbb3-408c-8fc9-29fa2dcc1661 for instance f16e1c2c-f691-43e9-b9d9-964c2ab7d943 on hv-cinder-83124 Aug 26 16:02:12.259769 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-318ffced-4073-48fe-8c4b-cf0c01d41876 req-86253733-eaa5-403d-995a-d43444be1438 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035299 Aug 26 16:02:12.270159 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 541/1087] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:12.270547 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-18f9e210-1e6b-4935-8370-5ef8acbefb7d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:12.278381 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-18f9e210-1e6b-4935-8370-5ef8acbefb7d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1313 microversion: 2.1 time: 0.164842 Aug 26 16:02:12.279164 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 547/1088] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:12 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:13.302074 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2102f439-624c-4139-b9a1-2843b6666e7e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:13.302907 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2102f439-624c-4139-b9a1-2843b6666e7e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:13.309576 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2102f439-624c-4139-b9a1-2843b6666e7e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:13.310071 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2102f439-624c-4139-b9a1-2843b6666e7e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:13.310511 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2102f439-624c-4139-b9a1-2843b6666e7e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:13.311228 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2102f439-624c-4139-b9a1-2843b6666e7e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:13.311682 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2102f439-624c-4139-b9a1-2843b6666e7e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:13.312138 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2102f439-624c-4139-b9a1-2843b6666e7e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:13.459234 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2102f439-624c-4139-b9a1-2843b6666e7e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:13.462988 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2102f439-624c-4139-b9a1-2843b6666e7e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1313 microversion: 2.1 time: 0.166309 Aug 26 16:02:13.463560 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 542/1089] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:13 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:14.486297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-ab1d9b24-02c9-42c7-8c3e-566e3965adaa tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:14.486927 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ab1d9b24-02c9-42c7-8c3e-566e3965adaa tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:14.494887 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ab1d9b24-02c9-42c7-8c3e-566e3965adaa tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:14.495612 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ab1d9b24-02c9-42c7-8c3e-566e3965adaa tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:14.496291 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ab1d9b24-02c9-42c7-8c3e-566e3965adaa tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:14.497331 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ab1d9b24-02c9-42c7-8c3e-566e3965adaa tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:14.498007 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ab1d9b24-02c9-42c7-8c3e-566e3965adaa tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:14.498637 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ab1d9b24-02c9-42c7-8c3e-566e3965adaa tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:14.648166 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ab1d9b24-02c9-42c7-8c3e-566e3965adaa tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:14.655841 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-ab1d9b24-02c9-42c7-8c3e-566e3965adaa tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1313 microversion: 2.1 time: 0.173424 Aug 26 16:02:14.656438 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 548/1090] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:14 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:15.677658 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7938831c-4b47-48d5-888e-bfc504638dfb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:15.678280 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7938831c-4b47-48d5-888e-bfc504638dfb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:15.685509 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7938831c-4b47-48d5-888e-bfc504638dfb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:15.686004 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7938831c-4b47-48d5-888e-bfc504638dfb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:15.686445 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7938831c-4b47-48d5-888e-bfc504638dfb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:15.687161 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7938831c-4b47-48d5-888e-bfc504638dfb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:15.687619 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7938831c-4b47-48d5-888e-bfc504638dfb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:15.688078 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7938831c-4b47-48d5-888e-bfc504638dfb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:15.822286 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7938831c-4b47-48d5-888e-bfc504638dfb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:15.830214 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7938831c-4b47-48d5-888e-bfc504638dfb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1313 microversion: 2.1 time: 0.156391 Aug 26 16:02:15.830788 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 543/1091] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:15 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:16.854346 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f0995d3e-e5d5-4540-bfd2-945418faf77a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:16.854911 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f0995d3e-e5d5-4540-bfd2-945418faf77a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:16.861064 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f0995d3e-e5d5-4540-bfd2-945418faf77a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:16.861555 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f0995d3e-e5d5-4540-bfd2-945418faf77a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:16.861997 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f0995d3e-e5d5-4540-bfd2-945418faf77a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:16.862706 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f0995d3e-e5d5-4540-bfd2-945418faf77a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:16.863192 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f0995d3e-e5d5-4540-bfd2-945418faf77a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:16.863615 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f0995d3e-e5d5-4540-bfd2-945418faf77a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:16.995410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f0995d3e-e5d5-4540-bfd2-945418faf77a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:17.003527 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f0995d3e-e5d5-4540-bfd2-945418faf77a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1313 microversion: 2.1 time: 0.156759 Aug 26 16:02:17.004658 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 549/1092] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:16 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:18.024785 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-15aeacad-a50e-4cad-9f58-466e7d537a50 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:18.025405 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-15aeacad-a50e-4cad-9f58-466e7d537a50 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:18.030105 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:18.035359 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15aeacad-a50e-4cad-9f58-466e7d537a50 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:18.035839 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15aeacad-a50e-4cad-9f58-466e7d537a50 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:18.036290 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15aeacad-a50e-4cad-9f58-466e7d537a50 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:18.036989 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15aeacad-a50e-4cad-9f58-466e7d537a50 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:18.037432 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15aeacad-a50e-4cad-9f58-466e7d537a50 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:18.037847 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-15aeacad-a50e-4cad-9f58-466e7d537a50 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:18.180904 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-15aeacad-a50e-4cad-9f58-466e7d537a50 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:18.188482 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-15aeacad-a50e-4cad-9f58-466e7d537a50 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1313 microversion: 2.1 time: 0.167706 Aug 26 16:02:18.189094 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 544/1093] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:18 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:19.016787 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:19.136158 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-b4ee8661-1a85-481b-b581-955d0fbe3187 req-35d12e00-12cf-4350-a3c5-0b8d8e8f19a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16e1c2c-f691-43e9-b9d9-964c2ab7d943", "name": "network-vif-plugged", "status": "completed", "tag": "d1a107ff-cbb3-408c-8fc9-29fa2dcc1661"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:19.146210 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-b4ee8661-1a85-481b-b581-955d0fbe3187 req-35d12e00-12cf-4350-a3c5-0b8d8e8f19a8 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:19.152237 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-b4ee8661-1a85-481b-b581-955d0fbe3187 req-35d12e00-12cf-4350-a3c5-0b8d8e8f19a8 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:19.152237 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-b4ee8661-1a85-481b-b581-955d0fbe3187 req-35d12e00-12cf-4350-a3c5-0b8d8e8f19a8 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:19.159208 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-b4ee8661-1a85-481b-b581-955d0fbe3187 req-35d12e00-12cf-4350-a3c5-0b8d8e8f19a8 service nova] Creating event network-vif-plugged:d1a107ff-cbb3-408c-8fc9-29fa2dcc1661 for instance f16e1c2c-f691-43e9-b9d9-964c2ab7d943 on hv-cinder-83124 Aug 26 16:02:19.164827 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-b4ee8661-1a85-481b-b581-955d0fbe3187 req-35d12e00-12cf-4350-a3c5-0b8d8e8f19a8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152504 Aug 26 16:02:19.165421 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 550/1094] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:19.210607 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-28b386e0-0682-4875-90d4-1e415edc11ab tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:19.211233 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-28b386e0-0682-4875-90d4-1e415edc11ab tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:19.213473 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=8 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:19.218418 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28b386e0-0682-4875-90d4-1e415edc11ab tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:19.218908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28b386e0-0682-4875-90d4-1e415edc11ab tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:19.219379 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28b386e0-0682-4875-90d4-1e415edc11ab tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:19.220114 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28b386e0-0682-4875-90d4-1e415edc11ab tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:19.220573 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28b386e0-0682-4875-90d4-1e415edc11ab tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:19.221038 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-28b386e0-0682-4875-90d4-1e415edc11ab tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:19.354815 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-28b386e0-0682-4875-90d4-1e415edc11ab tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:19.362508 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-28b386e0-0682-4875-90d4-1e415edc11ab tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1313 microversion: 2.1 time: 0.157142 Aug 26 16:02:19.363652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 545/1095] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:19 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:20.385223 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-878ef9f1-a632-4050-8322-95305848a7d7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:20.385913 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-878ef9f1-a632-4050-8322-95305848a7d7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:20.392919 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-878ef9f1-a632-4050-8322-95305848a7d7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:20.393404 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-878ef9f1-a632-4050-8322-95305848a7d7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:20.393837 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-878ef9f1-a632-4050-8322-95305848a7d7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:20.395042 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-878ef9f1-a632-4050-8322-95305848a7d7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:20.395496 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-878ef9f1-a632-4050-8322-95305848a7d7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:20.395946 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-878ef9f1-a632-4050-8322-95305848a7d7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:20.537727 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-878ef9f1-a632-4050-8322-95305848a7d7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:20.545855 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-878ef9f1-a632-4050-8322-95305848a7d7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1313 microversion: 2.1 time: 0.165655 Aug 26 16:02:20.546437 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 551/1096] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:20 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:21.568921 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-92f252ff-09e8-4325-a852-f9837373ed6f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:21.569565 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-92f252ff-09e8-4325-a852-f9837373ed6f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:21.577174 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-92f252ff-09e8-4325-a852-f9837373ed6f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:21.577664 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-92f252ff-09e8-4325-a852-f9837373ed6f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:21.578110 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-92f252ff-09e8-4325-a852-f9837373ed6f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:21.578819 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-92f252ff-09e8-4325-a852-f9837373ed6f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:21.579273 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-92f252ff-09e8-4325-a852-f9837373ed6f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:21.579754 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-92f252ff-09e8-4325-a852-f9837373ed6f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:21.728845 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-92f252ff-09e8-4325-a852-f9837373ed6f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:21.736852 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-92f252ff-09e8-4325-a852-f9837373ed6f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1497 microversion: 2.1 time: 0.172597 Aug 26 16:02:21.737496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 546/1097] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:21 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:22.914847 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7a98ab40-a0e6-4173-a18c-b2f199ed6926 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:22.915783 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7a98ab40-a0e6-4173-a18c-b2f199ed6926 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:22.923253 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a98ab40-a0e6-4173-a18c-b2f199ed6926 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:22.923786 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a98ab40-a0e6-4173-a18c-b2f199ed6926 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:22.924391 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a98ab40-a0e6-4173-a18c-b2f199ed6926 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:22.925248 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a98ab40-a0e6-4173-a18c-b2f199ed6926 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:22.926052 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a98ab40-a0e6-4173-a18c-b2f199ed6926 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:22.926537 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7a98ab40-a0e6-4173-a18c-b2f199ed6926 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:22.957208 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7a98ab40-a0e6-4173-a18c-b2f199ed6926 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Going to try to terminate instance {{(pid=127697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:02:23.308013 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7a98ab40-a0e6-4173-a18c-b2f199ed6926 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 204 len: 0 microversion: 2.1 time: 0.398135 Aug 26 16:02:23.308671 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 552/1098] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 16:02:22 2022] DELETE /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:02:23.318106 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-10e5c1c9-d3ab-4104-b0c5-da8faefcac27 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:23.318902 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-10e5c1c9-d3ab-4104-b0c5-da8faefcac27 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:23.326028 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-10e5c1c9-d3ab-4104-b0c5-da8faefcac27 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:23.326504 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-10e5c1c9-d3ab-4104-b0c5-da8faefcac27 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:23.326931 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-10e5c1c9-d3ab-4104-b0c5-da8faefcac27 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:23.327624 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-10e5c1c9-d3ab-4104-b0c5-da8faefcac27 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:23.328104 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-10e5c1c9-d3ab-4104-b0c5-da8faefcac27 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:23.328570 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-10e5c1c9-d3ab-4104-b0c5-da8faefcac27 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:23.476199 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-10e5c1c9-d3ab-4104-b0c5-da8faefcac27 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:23.484205 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-10e5c1c9-d3ab-4104-b0c5-da8faefcac27 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1503 microversion: 2.1 time: 0.170495 Aug 26 16:02:23.484783 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 547/1099] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:23 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:24.506791 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7fec46b5-8ed1-4085-9077-b6146756001d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:24.507495 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7fec46b5-8ed1-4085-9077-b6146756001d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:24.514082 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fec46b5-8ed1-4085-9077-b6146756001d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:24.514721 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fec46b5-8ed1-4085-9077-b6146756001d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:24.515157 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fec46b5-8ed1-4085-9077-b6146756001d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:24.515857 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fec46b5-8ed1-4085-9077-b6146756001d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:24.516483 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fec46b5-8ed1-4085-9077-b6146756001d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:24.516915 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7fec46b5-8ed1-4085-9077-b6146756001d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:24.660572 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7fec46b5-8ed1-4085-9077-b6146756001d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:24.672541 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7fec46b5-8ed1-4085-9077-b6146756001d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1503 microversion: 2.1 time: 0.170235 Aug 26 16:02:24.673641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 553/1100] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:24 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:25.431922 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-e95207fc-65ac-4ec4-812f-0a37e48fe3c1 req-e85bc3ac-dac7-4530-bee7-6cda5f605bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16e1c2c-f691-43e9-b9d9-964c2ab7d943", "name": "network-vif-deleted", "tag": "d1a107ff-cbb3-408c-8fc9-29fa2dcc1661"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:25.442685 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-e95207fc-65ac-4ec4-812f-0a37e48fe3c1 req-e85bc3ac-dac7-4530-bee7-6cda5f605bd6 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:25.448371 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-e95207fc-65ac-4ec4-812f-0a37e48fe3c1 req-e85bc3ac-dac7-4530-bee7-6cda5f605bd6 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:25.448371 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-e95207fc-65ac-4ec4-812f-0a37e48fe3c1 req-e85bc3ac-dac7-4530-bee7-6cda5f605bd6 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:25.458296 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-e95207fc-65ac-4ec4-812f-0a37e48fe3c1 req-e85bc3ac-dac7-4530-bee7-6cda5f605bd6 service nova] Creating event network-vif-deleted:d1a107ff-cbb3-408c-8fc9-29fa2dcc1661 for instance f16e1c2c-f691-43e9-b9d9-964c2ab7d943 on hv-cinder-83124 Aug 26 16:02:25.463499 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-e95207fc-65ac-4ec4-812f-0a37e48fe3c1 req-e85bc3ac-dac7-4530-bee7-6cda5f605bd6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035285 Aug 26 16:02:25.464133 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 548/1101] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:25.702309 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-929d4259-ac6e-4291-96fd-0c34448385fb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:25.702905 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-929d4259-ac6e-4291-96fd-0c34448385fb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:25.709994 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-929d4259-ac6e-4291-96fd-0c34448385fb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:25.714096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-929d4259-ac6e-4291-96fd-0c34448385fb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:25.714096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-929d4259-ac6e-4291-96fd-0c34448385fb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:25.714096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-929d4259-ac6e-4291-96fd-0c34448385fb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:25.714096 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-929d4259-ac6e-4291-96fd-0c34448385fb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:25.714525 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-929d4259-ac6e-4291-96fd-0c34448385fb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:25.778479 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-929d4259-ac6e-4291-96fd-0c34448385fb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:25.788457 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-929d4259-ac6e-4291-96fd-0c34448385fb tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 200 len: 1298 microversion: 2.1 time: 0.089919 Aug 26 16:02:25.789410 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 554/1102] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:25 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:26.811071 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-20ce391c-ad68-452d-bb98-b6cc5f250fea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:26.811783 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-20ce391c-ad68-452d-bb98-b6cc5f250fea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: f16e1c2c-f691-43e9-b9d9-964c2ab7d943] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:26.818637 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-20ce391c-ad68-452d-bb98-b6cc5f250fea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:26.819230 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-20ce391c-ad68-452d-bb98-b6cc5f250fea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:26.819675 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-20ce391c-ad68-452d-bb98-b6cc5f250fea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:26.820413 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-20ce391c-ad68-452d-bb98-b6cc5f250fea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:26.821134 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-20ce391c-ad68-452d-bb98-b6cc5f250fea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:26.821556 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-20ce391c-ad68-452d-bb98-b6cc5f250fea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:26.835814 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.wsgi [None req-20ce391c-ad68-452d-bb98-b6cc5f250fea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] HTTP exception thrown: Instance f16e1c2c-f691-43e9-b9d9-964c2ab7d943 could not be found. Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-20ce391c-ad68-452d-bb98-b6cc5f250fea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Request method failure captured: Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: request: GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 HTTP/1.1 Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept: application/json Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Accept-Encoding: identity Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Connection: close Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Length: 0 Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Content-Type: application/json Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Host: 10.222.0.98 Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Openstack-System-Scope: None Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: User-Agent: python-urllib3/1.26.11 Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Auth-Token: gAAAAABjCO5733E8GB5GIwSZ7HBMxSeZKlREtlBUwU2x-iGw3yxGjwAV7XzkimbEVf9_c7uN05eox1jSFZypydlfjnLxMGPid8FDVvejL_59j6QZGIax7y3aU1wWbI40vA7-Q2hmblWNAJO0l6oFA5CiSaEaTcnACo4Ls_3MSHy1pnuhNNE8xew Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Id: None Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Domain-Name: None Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Identity-Status: Confirmed Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Is-Admin-Project: True Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Id: default Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Domain-Name: Default Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Id: d4aca222b23d447d84c26967902508ea Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Project-Name: tempest-VolumesActionsTest-1611335737 Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Role: reader,member Aug 26 16:02:26.837700 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Roles: reader,member Aug 26 16:02:26.839500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d4aca222b23d447d84c26967902508ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d4aca222b23d447d84c26967902508ea", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d4aca222b23d447d84c26967902508ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d4aca222b23d447d84c26967902508ea"}]}] Aug 26 16:02:26.839500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant: tempest-VolumesActionsTest-1611335737 Aug 26 16:02:26.839500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Id: d4aca222b23d447d84c26967902508ea Aug 26 16:02:26.839500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-Tenant-Name: tempest-VolumesActionsTest-1611335737 Aug 26 16:02:26.839500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User: tempest-VolumesActionsTest-1611335737-project Aug 26 16:02:26.839500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Id: default Aug 26 16:02:26.839500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Domain-Name: Default Aug 26 16:02:26.839500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Id: 0df9431cefb742cc980351e7f8df8950 Aug 26 16:02:26.839500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: X-User-Name: tempest-VolumesActionsTest-1611335737-project Aug 26 16:02:26.839500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: method: > Aug 26 16:02:26.839500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: exception: Instance f16e1c2c-f691-43e9-b9d9-964c2ab7d943 could not be found. Aug 26 16:02:26.839500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: action_args: {'id': 'f16e1c2c-f691-43e9-b9d9-964c2ab7d943'} Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f16e1c2c-f691-43e9-b9d9-964c2ab7d943 could not be found. Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:02:26.840640 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f16e1c2c-f691-43e9-b9d9-964c2ab7d943 could not be found. Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f16e1c2c-f691-43e9-b9d9-964c2ab7d943 could not be found. Aug 26 16:02:26.842298 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR nova.api.openstack.wsgi Aug 26 16:02:26.844145 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-20ce391c-ad68-452d-bb98-b6cc5f250fea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Returning 404 to user: Instance f16e1c2c-f691-43e9-b9d9-964c2ab7d943 could not be found. {{(pid=127698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:02:26.844145 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-20ce391c-ad68-452d-bb98-b6cc5f250fea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943" status: 404 len: 111 microversion: 2.1 time: 0.033110 Aug 26 16:02:26.844145 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 549/1103] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:26 2022] GET /compute/v2.1/servers/f16e1c2c-f691-43e9-b9d9-964c2ab7d943 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:02:26.892869 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-69754587", "imageRef": "8a830d60-8955-4c99-a354-6a796596c7d9", "flavorRef": "452", "networks": [{"uuid": "7a2395dc-a7e7-47d2-a8f1-732bfc909be1"}]}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:26.952502 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.network.neutron [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] validate_networks() for [('7a2395dc-a7e7-47d2-a8f1-732bfc909be1', None, None, None, None, None)] {{(pid=127697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 16:02:27.328913 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Flavor limits 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 16:02:27.334740 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Image limits 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 16:02:27.334740 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Flavor pref 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 16:02:27.334740 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Image pref 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 16:02:27.334740 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 16:02:27.340307 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:27.340782 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:27.341212 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:27.341929 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:27.342377 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:27.342795 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:27.360439 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Getting quotas for project d4aca222b23d447d84c26967902508ea. Resources: {'ram', 'cores', 'instances'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:02:27.364523 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Getting quotas for user 0df9431cefb742cc980351e7f8df8950 and project d4aca222b23d447d84c26967902508ea. Resources: {'ram', 'cores', 'instances'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:02:27.376527 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Going to run 1 instances... {{(pid=127697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 16:02:27.378899 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8a830d60-8955-4c99-a354-6a796596c7d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 16:02:27.515519 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-e53c2b31-af62-4a15-b012-48310ca6a9c6 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626693 Aug 26 16:02:27.516205 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 555/1104] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 16:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 16:02:27.528112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3ee93fd1-821e-4c68-94b4-200ff7893320 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:27.528730 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3ee93fd1-821e-4c68-94b4-200ff7893320 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:27.585724 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3ee93fd1-821e-4c68-94b4-200ff7893320 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:27.592636 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3ee93fd1-821e-4c68-94b4-200ff7893320 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 200 len: 1212 microversion: 2.1 time: 0.068950 Aug 26 16:02:27.593424 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 550/1105] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:27 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 1212 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:28.614345 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-ce9851e8-71d3-4c1c-9cf7-fcf2db04490d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:28.614959 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-ce9851e8-71d3-4c1c-9cf7-fcf2db04490d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:28.621846 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ce9851e8-71d3-4c1c-9cf7-fcf2db04490d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:28.622328 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ce9851e8-71d3-4c1c-9cf7-fcf2db04490d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:28.622909 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ce9851e8-71d3-4c1c-9cf7-fcf2db04490d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:28.623607 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ce9851e8-71d3-4c1c-9cf7-fcf2db04490d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:28.624090 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ce9851e8-71d3-4c1c-9cf7-fcf2db04490d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:28.630553 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-ce9851e8-71d3-4c1c-9cf7-fcf2db04490d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:28.686199 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-ce9851e8-71d3-4c1c-9cf7-fcf2db04490d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:28.694786 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-ce9851e8-71d3-4c1c-9cf7-fcf2db04490d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 200 len: 1216 microversion: 2.1 time: 0.085294 Aug 26 16:02:28.695367 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 556/1106] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:28 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 1216 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:29.715839 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-75169646-a020-4aab-a92f-fb5aad873a40 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:29.716488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-75169646-a020-4aab-a92f-fb5aad873a40 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:29.724267 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-75169646-a020-4aab-a92f-fb5aad873a40 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:29.724743 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-75169646-a020-4aab-a92f-fb5aad873a40 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:29.725171 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-75169646-a020-4aab-a92f-fb5aad873a40 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:29.725858 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-75169646-a020-4aab-a92f-fb5aad873a40 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:29.726312 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-75169646-a020-4aab-a92f-fb5aad873a40 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:29.726734 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-75169646-a020-4aab-a92f-fb5aad873a40 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:29.794236 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-75169646-a020-4aab-a92f-fb5aad873a40 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:29.802786 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-75169646-a020-4aab-a92f-fb5aad873a40 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 200 len: 1264 microversion: 2.1 time: 0.090752 Aug 26 16:02:29.803364 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 551/1107] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:29 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 1264 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:30.824472 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-aaab6fad-30e4-4e91-8f43-329f4404f7f5 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:30.825252 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-aaab6fad-30e4-4e91-8f43-329f4404f7f5 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:30.832143 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aaab6fad-30e4-4e91-8f43-329f4404f7f5 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:30.832631 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aaab6fad-30e4-4e91-8f43-329f4404f7f5 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:30.833070 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aaab6fad-30e4-4e91-8f43-329f4404f7f5 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:30.833769 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aaab6fad-30e4-4e91-8f43-329f4404f7f5 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:30.834230 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aaab6fad-30e4-4e91-8f43-329f4404f7f5 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:30.834657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aaab6fad-30e4-4e91-8f43-329f4404f7f5 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:30.974360 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-aaab6fad-30e4-4e91-8f43-329f4404f7f5 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:30.982440 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-aaab6fad-30e4-4e91-8f43-329f4404f7f5 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 200 len: 1312 microversion: 2.1 time: 0.162070 Aug 26 16:02:30.984445 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 557/1108] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:30 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:31.628427 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-dd7fc14b-d1ca-433b-b4ea-58e79eaf1d9e req-621778ec-959d-48f0-97f7-838fafb2066a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f1be57-bbc6-46fb-a4b1-0c450ba2e791", "tag": "b7240ca7-0a0b-4505-94e9-e6fe6243f9e1"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:31.638533 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-dd7fc14b-d1ca-433b-b4ea-58e79eaf1d9e req-621778ec-959d-48f0-97f7-838fafb2066a service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:31.639028 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-dd7fc14b-d1ca-433b-b4ea-58e79eaf1d9e req-621778ec-959d-48f0-97f7-838fafb2066a service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:31.639466 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-dd7fc14b-d1ca-433b-b4ea-58e79eaf1d9e req-621778ec-959d-48f0-97f7-838fafb2066a service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:31.651172 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-dd7fc14b-d1ca-433b-b4ea-58e79eaf1d9e req-621778ec-959d-48f0-97f7-838fafb2066a service nova] Creating event network-changed:b7240ca7-0a0b-4505-94e9-e6fe6243f9e1 for instance 99f1be57-bbc6-46fb-a4b1-0c450ba2e791 on hv-cinder-83124 Aug 26 16:02:31.657682 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-dd7fc14b-d1ca-433b-b4ea-58e79eaf1d9e req-621778ec-959d-48f0-97f7-838fafb2066a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034140 Aug 26 16:02:31.659642 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 552/1109] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:32.006235 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6182630c-3029-46f5-9c55-baeace9f34b7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:32.006940 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6182630c-3029-46f5-9c55-baeace9f34b7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:32.013791 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6182630c-3029-46f5-9c55-baeace9f34b7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:32.014265 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6182630c-3029-46f5-9c55-baeace9f34b7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:32.014805 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6182630c-3029-46f5-9c55-baeace9f34b7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:32.015520 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6182630c-3029-46f5-9c55-baeace9f34b7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:32.016142 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6182630c-3029-46f5-9c55-baeace9f34b7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:32.016622 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6182630c-3029-46f5-9c55-baeace9f34b7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:32.160951 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6182630c-3029-46f5-9c55-baeace9f34b7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:32.168623 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6182630c-3029-46f5-9c55-baeace9f34b7 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 200 len: 1312 microversion: 2.1 time: 0.166499 Aug 26 16:02:32.169198 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 558/1110] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:32 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:33.190543 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-fac0dc57-5d8a-46f9-8562-18ce6e951639 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:33.191405 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-fac0dc57-5d8a-46f9-8562-18ce6e951639 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:33.198001 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fac0dc57-5d8a-46f9-8562-18ce6e951639 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:33.198470 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fac0dc57-5d8a-46f9-8562-18ce6e951639 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:33.198935 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fac0dc57-5d8a-46f9-8562-18ce6e951639 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:33.199663 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fac0dc57-5d8a-46f9-8562-18ce6e951639 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:33.200141 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fac0dc57-5d8a-46f9-8562-18ce6e951639 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:33.200555 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-fac0dc57-5d8a-46f9-8562-18ce6e951639 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:33.333688 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-fac0dc57-5d8a-46f9-8562-18ce6e951639 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:33.341713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-fac0dc57-5d8a-46f9-8562-18ce6e951639 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 200 len: 1312 microversion: 2.1 time: 0.156030 Aug 26 16:02:33.342372 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 553/1111] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:33 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:34.363940 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c97c3ee2-827b-404f-9660-9a4b5710f74e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:34.364536 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c97c3ee2-827b-404f-9660-9a4b5710f74e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:34.371208 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c97c3ee2-827b-404f-9660-9a4b5710f74e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:34.371686 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c97c3ee2-827b-404f-9660-9a4b5710f74e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:34.372154 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c97c3ee2-827b-404f-9660-9a4b5710f74e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:34.372843 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c97c3ee2-827b-404f-9660-9a4b5710f74e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:34.373292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c97c3ee2-827b-404f-9660-9a4b5710f74e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:34.373713 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c97c3ee2-827b-404f-9660-9a4b5710f74e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:34.505481 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c97c3ee2-827b-404f-9660-9a4b5710f74e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:34.513426 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c97c3ee2-827b-404f-9660-9a4b5710f74e tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 200 len: 1312 microversion: 2.1 time: 0.153967 Aug 26 16:02:34.514003 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 559/1112] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:34 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:35.534739 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2f565b67-d0d0-4b5e-8f91-18b37a37b357 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:35.535381 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2f565b67-d0d0-4b5e-8f91-18b37a37b357 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:35.542779 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f565b67-d0d0-4b5e-8f91-18b37a37b357 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:35.543323 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f565b67-d0d0-4b5e-8f91-18b37a37b357 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:35.549584 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f565b67-d0d0-4b5e-8f91-18b37a37b357 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:35.549584 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f565b67-d0d0-4b5e-8f91-18b37a37b357 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:35.549584 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f565b67-d0d0-4b5e-8f91-18b37a37b357 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:35.549584 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f565b67-d0d0-4b5e-8f91-18b37a37b357 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:35.680585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2f565b67-d0d0-4b5e-8f91-18b37a37b357 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:35.688416 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2f565b67-d0d0-4b5e-8f91-18b37a37b357 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 200 len: 1312 microversion: 2.1 time: 0.157665 Aug 26 16:02:35.688991 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 554/1113] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:35 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:36.709365 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-59193eb9-a38b-448d-9be9-9c0ceed966b4 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:36.710069 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-59193eb9-a38b-448d-9be9-9c0ceed966b4 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:36.716473 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-59193eb9-a38b-448d-9be9-9c0ceed966b4 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:36.716946 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-59193eb9-a38b-448d-9be9-9c0ceed966b4 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:36.717381 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-59193eb9-a38b-448d-9be9-9c0ceed966b4 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:36.718072 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-59193eb9-a38b-448d-9be9-9c0ceed966b4 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:36.718526 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-59193eb9-a38b-448d-9be9-9c0ceed966b4 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:36.718949 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-59193eb9-a38b-448d-9be9-9c0ceed966b4 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:36.852222 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-59193eb9-a38b-448d-9be9-9c0ceed966b4 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:36.861158 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-59193eb9-a38b-448d-9be9-9c0ceed966b4 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 200 len: 1312 microversion: 2.1 time: 0.155653 Aug 26 16:02:36.861651 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 560/1114] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:36 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:37.125237 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-34d8e786-d309-4e1b-91ff-3cb93e19475c req-621dcaf9-809a-4381-b214-ee5db6265388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f1be57-bbc6-46fb-a4b1-0c450ba2e791", "name": "network-vif-plugged", "status": "completed", "tag": "b7240ca7-0a0b-4505-94e9-e6fe6243f9e1"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:37.131304 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:37.136544 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-34d8e786-d309-4e1b-91ff-3cb93e19475c req-621dcaf9-809a-4381-b214-ee5db6265388 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:37.137065 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-34d8e786-d309-4e1b-91ff-3cb93e19475c req-621dcaf9-809a-4381-b214-ee5db6265388 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:37.137476 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-34d8e786-d309-4e1b-91ff-3cb93e19475c req-621dcaf9-809a-4381-b214-ee5db6265388 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:37.141115 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=71 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:37.148402 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-34d8e786-d309-4e1b-91ff-3cb93e19475c req-621dcaf9-809a-4381-b214-ee5db6265388 service nova] Creating event network-vif-plugged:b7240ca7-0a0b-4505-94e9-e6fe6243f9e1 for instance 99f1be57-bbc6-46fb-a4b1-0c450ba2e791 on hv-cinder-83124 Aug 26 16:02:37.153438 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-34d8e786-d309-4e1b-91ff-3cb93e19475c req-621dcaf9-809a-4381-b214-ee5db6265388 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031973 Aug 26 16:02:37.156011 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 555/1115] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:02:37.882728 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-976c8d00-1b89-47a6-9a8a-10624b87b93d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:37.883352 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-976c8d00-1b89-47a6-9a8a-10624b87b93d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:37.885326 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:37.886789 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=6 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:37.891430 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-976c8d00-1b89-47a6-9a8a-10624b87b93d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:37.891943 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-976c8d00-1b89-47a6-9a8a-10624b87b93d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:37.892384 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-976c8d00-1b89-47a6-9a8a-10624b87b93d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:37.893125 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-976c8d00-1b89-47a6-9a8a-10624b87b93d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:37.893527 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-976c8d00-1b89-47a6-9a8a-10624b87b93d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:37.893952 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-976c8d00-1b89-47a6-9a8a-10624b87b93d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:37.897110 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:38.030807 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-976c8d00-1b89-47a6-9a8a-10624b87b93d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:38.038919 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-976c8d00-1b89-47a6-9a8a-10624b87b93d tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 200 len: 1312 microversion: 2.1 time: 0.160715 Aug 26 16:02:38.039478 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 561/1116] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:37 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:39.057491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:39.062652 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-81b1c68f-20dd-4df8-b709-daa4704f390a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:39.070932 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-81b1c68f-20dd-4df8-b709-daa4704f390a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:39.071587 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-81b1c68f-20dd-4df8-b709-daa4704f390a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:39.072121 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-81b1c68f-20dd-4df8-b709-daa4704f390a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:39.072561 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-81b1c68f-20dd-4df8-b709-daa4704f390a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:39.073265 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-81b1c68f-20dd-4df8-b709-daa4704f390a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:39.073721 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-81b1c68f-20dd-4df8-b709-daa4704f390a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:39.074143 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-81b1c68f-20dd-4df8-b709-daa4704f390a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:39.208471 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-81b1c68f-20dd-4df8-b709-daa4704f390a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:39.216273 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-81b1c68f-20dd-4df8-b709-daa4704f390a tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 200 len: 1312 microversion: 2.1 time: 0.159678 Aug 26 16:02:39.217438 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 556/1117] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:39 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:40.236566 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-aba35058-2020-4aaa-9422-4dd52256f500 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:40.237188 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-aba35058-2020-4aaa-9422-4dd52256f500 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:40.239374 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:40.244368 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aba35058-2020-4aaa-9422-4dd52256f500 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:40.244900 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aba35058-2020-4aaa-9422-4dd52256f500 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:40.245294 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aba35058-2020-4aaa-9422-4dd52256f500 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:40.246011 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aba35058-2020-4aaa-9422-4dd52256f500 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:40.246495 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aba35058-2020-4aaa-9422-4dd52256f500 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:40.247333 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-aba35058-2020-4aaa-9422-4dd52256f500 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:40.379346 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-aba35058-2020-4aaa-9422-4dd52256f500 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:40.387280 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-aba35058-2020-4aaa-9422-4dd52256f500 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 200 len: 1496 microversion: 2.1 time: 0.154815 Aug 26 16:02:40.387842 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 562/1118] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:40 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 1496 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:41.368075 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a16185f0-4748-4d62-8d6f-9a093e6e758f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:41.368645 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a16185f0-4748-4d62-8d6f-9a093e6e758f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:41.374835 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a16185f0-4748-4d62-8d6f-9a093e6e758f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:41.375312 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a16185f0-4748-4d62-8d6f-9a093e6e758f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:41.382901 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a16185f0-4748-4d62-8d6f-9a093e6e758f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:41.382901 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a16185f0-4748-4d62-8d6f-9a093e6e758f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:41.382901 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a16185f0-4748-4d62-8d6f-9a093e6e758f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:41.382901 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a16185f0-4748-4d62-8d6f-9a093e6e758f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:41.404648 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a16185f0-4748-4d62-8d6f-9a093e6e758f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Going to try to terminate instance {{(pid=127698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:02:41.809545 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-a16185f0-4748-4d62-8d6f-9a093e6e758f tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "DELETE /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 204 len: 0 microversion: 2.1 time: 0.446339 Aug 26 16:02:41.813650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 557/1119] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 16:02:41 2022] DELETE /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:02:41.818133 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0a735fe1-b799-45d7-b431-347be0a2e597 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:41.818774 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0a735fe1-b799-45d7-b431-347be0a2e597 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:41.826286 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a735fe1-b799-45d7-b431-347be0a2e597 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:41.826762 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a735fe1-b799-45d7-b431-347be0a2e597 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:41.827197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a735fe1-b799-45d7-b431-347be0a2e597 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:41.827918 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a735fe1-b799-45d7-b431-347be0a2e597 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:41.828379 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a735fe1-b799-45d7-b431-347be0a2e597 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:41.828798 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a735fe1-b799-45d7-b431-347be0a2e597 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:41.962549 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0a735fe1-b799-45d7-b431-347be0a2e597 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:41.970699 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0a735fe1-b799-45d7-b431-347be0a2e597 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 200 len: 1502 microversion: 2.1 time: 0.156384 Aug 26 16:02:41.971272 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 563/1120] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:41 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:42.992949 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-52bf69d2-989f-4b5f-a923-54e58e6de55b tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:42.993650 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-52bf69d2-989f-4b5f-a923-54e58e6de55b tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:43.000032 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-52bf69d2-989f-4b5f-a923-54e58e6de55b tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:43.000509 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-52bf69d2-989f-4b5f-a923-54e58e6de55b tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:43.000942 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-52bf69d2-989f-4b5f-a923-54e58e6de55b tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:43.001704 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-52bf69d2-989f-4b5f-a923-54e58e6de55b tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:43.002157 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-52bf69d2-989f-4b5f-a923-54e58e6de55b tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:43.002614 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-52bf69d2-989f-4b5f-a923-54e58e6de55b tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:43.135034 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-52bf69d2-989f-4b5f-a923-54e58e6de55b tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:43.142812 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-52bf69d2-989f-4b5f-a923-54e58e6de55b tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 200 len: 1502 microversion: 2.1 time: 0.154735 Aug 26 16:02:43.143388 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 558/1121] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:42 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:44.038763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-fbd43faa-b294-42cd-8183-22502772a887 req-5d7f82ba-0d97-4331-bd39-5b7bc3243a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f1be57-bbc6-46fb-a4b1-0c450ba2e791", "name": "network-vif-deleted", "tag": "b7240ca7-0a0b-4505-94e9-e6fe6243f9e1"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:44.055687 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-fbd43faa-b294-42cd-8183-22502772a887 req-5d7f82ba-0d97-4331-bd39-5b7bc3243a8b service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:44.055687 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-fbd43faa-b294-42cd-8183-22502772a887 req-5d7f82ba-0d97-4331-bd39-5b7bc3243a8b service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:44.055687 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-fbd43faa-b294-42cd-8183-22502772a887 req-5d7f82ba-0d97-4331-bd39-5b7bc3243a8b service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:44.060740 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-fbd43faa-b294-42cd-8183-22502772a887 req-5d7f82ba-0d97-4331-bd39-5b7bc3243a8b service nova] Creating event network-vif-deleted:b7240ca7-0a0b-4505-94e9-e6fe6243f9e1 for instance 99f1be57-bbc6-46fb-a4b1-0c450ba2e791 on hv-cinder-83124 Aug 26 16:02:44.065746 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-fbd43faa-b294-42cd-8183-22502772a887 req-5d7f82ba-0d97-4331-bd39-5b7bc3243a8b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030836 Aug 26 16:02:44.066870 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 564/1122] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:44.163849 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-14101b70-77e6-47e9-9356-d4321294d5ea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:44.164496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-14101b70-77e6-47e9-9356-d4321294d5ea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:44.170892 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-14101b70-77e6-47e9-9356-d4321294d5ea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:44.171366 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-14101b70-77e6-47e9-9356-d4321294d5ea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:44.171785 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-14101b70-77e6-47e9-9356-d4321294d5ea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:44.172495 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-14101b70-77e6-47e9-9356-d4321294d5ea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:44.172944 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-14101b70-77e6-47e9-9356-d4321294d5ea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:44.173359 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-14101b70-77e6-47e9-9356-d4321294d5ea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:44.243302 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-14101b70-77e6-47e9-9356-d4321294d5ea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df9431cefb742cc980351e7f8df8950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4aca222b23d447d84c26967902508ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:44.251094 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-14101b70-77e6-47e9-9356-d4321294d5ea tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 200 len: 1460 microversion: 2.1 time: 0.091156 Aug 26 16:02:44.251657 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 559/1123] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:44 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 1460 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:45.274433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-10d8dc32-28a1-4bd3-8b87-b4b3e4840cf3 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:45.275142 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-10d8dc32-28a1-4bd3-8b87-b4b3e4840cf3 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] [instance: 99f1be57-bbc6-46fb-a4b1-0c450ba2e791] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:45.281479 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-10d8dc32-28a1-4bd3-8b87-b4b3e4840cf3 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:45.281953 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-10d8dc32-28a1-4bd3-8b87-b4b3e4840cf3 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:45.293074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-10d8dc32-28a1-4bd3-8b87-b4b3e4840cf3 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:45.293074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-10d8dc32-28a1-4bd3-8b87-b4b3e4840cf3 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:45.293074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-10d8dc32-28a1-4bd3-8b87-b4b3e4840cf3 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:45.293074 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-10d8dc32-28a1-4bd3-8b87-b4b3e4840cf3 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:45.297735 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-10d8dc32-28a1-4bd3-8b87-b4b3e4840cf3 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] HTTP exception thrown: Instance 99f1be57-bbc6-46fb-a4b1-0c450ba2e791 could not be found. Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-10d8dc32-28a1-4bd3-8b87-b4b3e4840cf3 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Request method failure captured: Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 HTTP/1.1 Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCO5733E8GB5GIwSZ7HBMxSeZKlREtlBUwU2x-iGw3yxGjwAV7XzkimbEVf9_c7uN05eox1jSFZypydlfjnLxMGPid8FDVvejL_59j6QZGIax7y3aU1wWbI40vA7-Q2hmblWNAJO0l6oFA5CiSaEaTcnACo4Ls_3MSHy1pnuhNNE8xew Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: d4aca222b23d447d84c26967902508ea Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-VolumesActionsTest-1611335737 Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 16:02:45.299460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 16:02:45.301209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d4aca222b23d447d84c26967902508ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d4aca222b23d447d84c26967902508ea", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d4aca222b23d447d84c26967902508ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d4aca222b23d447d84c26967902508ea"}]}] Aug 26 16:02:45.301209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-VolumesActionsTest-1611335737 Aug 26 16:02:45.301209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: d4aca222b23d447d84c26967902508ea Aug 26 16:02:45.301209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-VolumesActionsTest-1611335737 Aug 26 16:02:45.301209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-VolumesActionsTest-1611335737-project Aug 26 16:02:45.301209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 16:02:45.301209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 16:02:45.301209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 0df9431cefb742cc980351e7f8df8950 Aug 26 16:02:45.301209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-VolumesActionsTest-1611335737-project Aug 26 16:02:45.301209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 16:02:45.301209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 99f1be57-bbc6-46fb-a4b1-0c450ba2e791 could not be found. Aug 26 16:02:45.301209 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '99f1be57-bbc6-46fb-a4b1-0c450ba2e791'} Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f1be57-bbc6-46fb-a4b1-0c450ba2e791 could not be found. Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:02:45.302603 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f1be57-bbc6-46fb-a4b1-0c450ba2e791 could not be found. Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f1be57-bbc6-46fb-a4b1-0c450ba2e791 could not be found. Aug 26 16:02:45.304297 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:02:45.306183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-10d8dc32-28a1-4bd3-8b87-b4b3e4840cf3 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] Returning 404 to user: Instance 99f1be57-bbc6-46fb-a4b1-0c450ba2e791 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:02:45.306183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-10d8dc32-28a1-4bd3-8b87-b4b3e4840cf3 tempest-VolumesActionsTest-1611335737 tempest-VolumesActionsTest-1611335737-project] 10.222.0.98 "GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791" status: 404 len: 111 microversion: 2.1 time: 0.031998 Aug 26 16:02:45.306183 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 565/1124] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:45 2022] GET /compute/v2.1/servers/99f1be57-bbc6-46fb-a4b1-0c450ba2e791 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:03:50.981196 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:03:50.981967 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:03:50.983074 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 16:03:50.983215 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Fri Aug 26 16:03:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.98) !!! Aug 26 16:03:51.169734 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-07fb86d5-c673-4610-8748-c5a7241650d1 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Action: 'create', calling method: .version_select at 0x7fbd1e28f820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1827898613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1CSP+JgC8B2CmJgxXsps+VuzsoKLzryZTEHO2wS+TkD/2nLZBfsWFcQE1TLucecU189Ap5QRKsA5Jww+SW9+qYIn3mqwYGhyfq5s7DG7FR/FMpiVkS3AzM2lGfqjZZqw=="}} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:51.185707 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-07fb86d5-c673-4610-8748-c5a7241650d1 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Getting quotas for project b7eea71358e140c29fa3df652ce95a6b. Resources: {'key_pairs'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:03:51.189480 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.quota [None req-07fb86d5-c673-4610-8748-c5a7241650d1 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Getting quotas for user 4b66de0ca9674a989cac17ca80b6cbb7 and project b7eea71358e140c29fa3df652ce95a6b. Resources: {'key_pairs'} {{(pid=127698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:03:51.301227 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-07fb86d5-c673-4610-8748-c5a7241650d1 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.322030 Aug 26 16:03:51.302025 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 560/1125] 10.222.0.98 () {60 vars in 1159 bytes} [Fri Aug 26 16:03:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:10.093191 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=7 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:10.093942 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=21 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:10.098518 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1009427079", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1827898613", "security_groups": [{"name": "tempest-secgroup-smoke-132664049"}], "networks": [{"uuid": "2f647456-7cc5-4aba-8ec5-e3b187294adc"}], "block_device_mapping_v2": [{"uuid": "40d3bf5e-9678-4001-85ba-f900cf14385c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:10.212995 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.network.neutron [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] validate_networks() for [('2f647456-7cc5-4aba-8ec5-e3b187294adc', None, None, None, None, None)] {{(pid=127697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 16:04:10.588476 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Flavor limits 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 16:04:10.588977 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Image limits 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 16:04:10.589539 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Flavor pref 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 16:04:10.589947 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Image pref 0:0:0 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 16:04:10.590359 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.virt.hardware [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 16:04:10.600327 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:10.600815 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:10.601254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:10.601991 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:10.602442 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:10.603008 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:10.621128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Getting quotas for project b7eea71358e140c29fa3df652ce95a6b. Resources: {'ram', 'cores', 'instances'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:04:10.625956 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.quota [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Getting quotas for user 4b66de0ca9674a989cac17ca80b6cbb7 and project b7eea71358e140c29fa3df652ce95a6b. Resources: {'ram', 'cores', 'instances'} {{(pid=127697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:04:10.685535 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Going to run 1 instances... {{(pid=127697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 16:04:10.687752 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40d3bf5e-9678-4001-85ba-f900cf14385c',volume_size=None,volume_type=None)] {{(pid=127697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 16:04:11.135846 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-9c20a6d9-ccb3-4b1c-af7c-1407c783d469 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.044473 Aug 26 16:04:11.136687 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 566/1126] 10.222.0.98 () {60 vars in 1147 bytes} [Fri Aug 26 16:04:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 16:04:11.147488 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-9bdadad9-156e-44e0-8af2-46e4dcaf0560 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:11.148328 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-9bdadad9-156e-44e0-8af2-46e4dcaf0560 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:11.152323 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=4 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:11.153820 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:11.208585 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-9bdadad9-156e-44e0-8af2-46e4dcaf0560 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:11.215980 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-9bdadad9-156e-44e0-8af2-46e4dcaf0560 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1089 microversion: 2.1 time: 0.072398 Aug 26 16:04:11.216671 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 561/1127] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:11 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:12.237151 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a43b7e18-e627-47a0-863f-f0b2a3c6b208 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:12.237768 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a43b7e18-e627-47a0-863f-f0b2a3c6b208 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:12.244516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a43b7e18-e627-47a0-863f-f0b2a3c6b208 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:12.245001 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a43b7e18-e627-47a0-863f-f0b2a3c6b208 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:12.245441 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a43b7e18-e627-47a0-863f-f0b2a3c6b208 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:12.246138 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a43b7e18-e627-47a0-863f-f0b2a3c6b208 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:12.246590 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a43b7e18-e627-47a0-863f-f0b2a3c6b208 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:12.247015 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a43b7e18-e627-47a0-863f-f0b2a3c6b208 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:12.312794 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a43b7e18-e627-47a0-863f-f0b2a3c6b208 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:12.320889 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a43b7e18-e627-47a0-863f-f0b2a3c6b208 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1139 microversion: 2.1 time: 0.087590 Aug 26 16:04:12.321460 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 567/1128] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:12 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:13.341763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-9707151c-071b-4086-8134-47c2d466910f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:13.342335 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-9707151c-071b-4086-8134-47c2d466910f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:13.349436 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9707151c-071b-4086-8134-47c2d466910f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:13.349917 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9707151c-071b-4086-8134-47c2d466910f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:13.350354 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9707151c-071b-4086-8134-47c2d466910f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:13.351044 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9707151c-071b-4086-8134-47c2d466910f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:13.351496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9707151c-071b-4086-8134-47c2d466910f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:13.351949 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-9707151c-071b-4086-8134-47c2d466910f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:13.414445 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-9707151c-071b-4086-8134-47c2d466910f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:13.422461 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-9707151c-071b-4086-8134-47c2d466910f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1187 microversion: 2.1 time: 0.084591 Aug 26 16:04:13.423036 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 562/1129] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:13 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:14.443438 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-7e740dcf-f3b7-443e-8327-9d3757bf84c7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:14.444141 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-7e740dcf-f3b7-443e-8327-9d3757bf84c7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:14.451298 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7e740dcf-f3b7-443e-8327-9d3757bf84c7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:14.451766 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7e740dcf-f3b7-443e-8327-9d3757bf84c7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:14.452232 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7e740dcf-f3b7-443e-8327-9d3757bf84c7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:14.453181 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7e740dcf-f3b7-443e-8327-9d3757bf84c7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:14.453882 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7e740dcf-f3b7-443e-8327-9d3757bf84c7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:14.454468 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-7e740dcf-f3b7-443e-8327-9d3757bf84c7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:14.605065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-7e740dcf-f3b7-443e-8327-9d3757bf84c7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:14.613983 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-7e740dcf-f3b7-443e-8327-9d3757bf84c7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1272 microversion: 2.1 time: 0.174420 Aug 26 16:04:14.623078 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 568/1130] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:14 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:15.535241 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-47c1982d-82db-47c3-8011-5ecd9b0d8d71 req-8930e947-6ee8-4ce8-b409-fe9a185ee341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85bcd3d4-0eae-48e0-9877-b62bab4470b8", "tag": "b6648bb5-3c8b-4235-b7db-d22730f77068"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:15.546155 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-47c1982d-82db-47c3-8011-5ecd9b0d8d71 req-8930e947-6ee8-4ce8-b409-fe9a185ee341 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:15.546735 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-47c1982d-82db-47c3-8011-5ecd9b0d8d71 req-8930e947-6ee8-4ce8-b409-fe9a185ee341 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:15.547240 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-47c1982d-82db-47c3-8011-5ecd9b0d8d71 req-8930e947-6ee8-4ce8-b409-fe9a185ee341 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:15.558148 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-47c1982d-82db-47c3-8011-5ecd9b0d8d71 req-8930e947-6ee8-4ce8-b409-fe9a185ee341 service nova] Creating event network-changed:b6648bb5-3c8b-4235-b7db-d22730f77068 for instance 85bcd3d4-0eae-48e0-9877-b62bab4470b8 on hv-cinder-83124 Aug 26 16:04:15.563111 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-47c1982d-82db-47c3-8011-5ecd9b0d8d71 req-8930e947-6ee8-4ce8-b409-fe9a185ee341 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039440 Aug 26 16:04:15.566207 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 563/1131] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:15.636334 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-57821eb2-3e8d-4bc7-9fb9-ad8af74b0bc9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:15.636932 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-57821eb2-3e8d-4bc7-9fb9-ad8af74b0bc9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:15.643993 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57821eb2-3e8d-4bc7-9fb9-ad8af74b0bc9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:15.644418 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57821eb2-3e8d-4bc7-9fb9-ad8af74b0bc9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:15.644856 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57821eb2-3e8d-4bc7-9fb9-ad8af74b0bc9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:15.645548 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57821eb2-3e8d-4bc7-9fb9-ad8af74b0bc9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:15.645998 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57821eb2-3e8d-4bc7-9fb9-ad8af74b0bc9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:15.646421 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-57821eb2-3e8d-4bc7-9fb9-ad8af74b0bc9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:15.780618 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-57821eb2-3e8d-4bc7-9fb9-ad8af74b0bc9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:15.788530 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-57821eb2-3e8d-4bc7-9fb9-ad8af74b0bc9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1260 microversion: 2.1 time: 0.156226 Aug 26 16:04:15.789106 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 569/1132] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:15 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:16.811126 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8fc002ff-19d7-4826-9b94-3e5cbc7a6abe tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:16.811747 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-8fc002ff-19d7-4826-9b94-3e5cbc7a6abe tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:16.817958 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8fc002ff-19d7-4826-9b94-3e5cbc7a6abe tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:16.818441 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8fc002ff-19d7-4826-9b94-3e5cbc7a6abe tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:16.818879 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8fc002ff-19d7-4826-9b94-3e5cbc7a6abe tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:16.819566 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8fc002ff-19d7-4826-9b94-3e5cbc7a6abe tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:16.820051 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8fc002ff-19d7-4826-9b94-3e5cbc7a6abe tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:16.820739 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8fc002ff-19d7-4826-9b94-3e5cbc7a6abe tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:16.954782 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8fc002ff-19d7-4826-9b94-3e5cbc7a6abe tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:16.962552 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-8fc002ff-19d7-4826-9b94-3e5cbc7a6abe tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1260 microversion: 2.1 time: 0.156772 Aug 26 16:04:16.963119 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 564/1133] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:16 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:17.982769 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1cbeed01-2249-4562-906f-25f41a74c779 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:17.983405 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1cbeed01-2249-4562-906f-25f41a74c779 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:17.989857 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1cbeed01-2249-4562-906f-25f41a74c779 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:17.990332 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1cbeed01-2249-4562-906f-25f41a74c779 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:17.990775 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1cbeed01-2249-4562-906f-25f41a74c779 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:17.991464 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1cbeed01-2249-4562-906f-25f41a74c779 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:17.991939 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1cbeed01-2249-4562-906f-25f41a74c779 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:17.992369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1cbeed01-2249-4562-906f-25f41a74c779 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:18.138987 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-1cbeed01-2249-4562-906f-25f41a74c779 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:18.146804 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1cbeed01-2249-4562-906f-25f41a74c779 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1260 microversion: 2.1 time: 0.167880 Aug 26 16:04:18.147382 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 570/1134] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:17 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:19.168400 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8ddc793e-6d74-4a81-8de2-978f6576c445 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:19.169007 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-8ddc793e-6d74-4a81-8de2-978f6576c445 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:19.174913 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8ddc793e-6d74-4a81-8de2-978f6576c445 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:19.175384 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8ddc793e-6d74-4a81-8de2-978f6576c445 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:19.175812 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8ddc793e-6d74-4a81-8de2-978f6576c445 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:19.176516 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8ddc793e-6d74-4a81-8de2-978f6576c445 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:19.176955 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8ddc793e-6d74-4a81-8de2-978f6576c445 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:19.177371 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8ddc793e-6d74-4a81-8de2-978f6576c445 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:19.311755 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8ddc793e-6d74-4a81-8de2-978f6576c445 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:19.319409 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-8ddc793e-6d74-4a81-8de2-978f6576c445 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1260 microversion: 2.1 time: 0.155197 Aug 26 16:04:19.319982 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 565/1135] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:19 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:20.341739 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-856f9c97-416e-4268-b416-bbada99403e7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:20.342344 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-856f9c97-416e-4268-b416-bbada99403e7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:20.348867 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-856f9c97-416e-4268-b416-bbada99403e7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:20.349340 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-856f9c97-416e-4268-b416-bbada99403e7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:20.349803 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-856f9c97-416e-4268-b416-bbada99403e7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:20.350494 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-856f9c97-416e-4268-b416-bbada99403e7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:20.350936 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-856f9c97-416e-4268-b416-bbada99403e7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:20.351354 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-856f9c97-416e-4268-b416-bbada99403e7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:20.481841 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-856f9c97-416e-4268-b416-bbada99403e7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:20.489504 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-856f9c97-416e-4268-b416-bbada99403e7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1260 microversion: 2.1 time: 0.152280 Aug 26 16:04:20.490067 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 571/1136] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:20 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:21.517762 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-44276173-037d-4713-b169-be72a6306811 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:21.518334 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-44276173-037d-4713-b169-be72a6306811 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:21.520777 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell0:SELECT=2 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:21.525929 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-44276173-037d-4713-b169-be72a6306811 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:21.526416 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-44276173-037d-4713-b169-be72a6306811 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:21.531492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-44276173-037d-4713-b169-be72a6306811 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:21.531492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-44276173-037d-4713-b169-be72a6306811 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:21.531492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-44276173-037d-4713-b169-be72a6306811 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:21.531492 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-44276173-037d-4713-b169-be72a6306811 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:21.663061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-44276173-037d-4713-b169-be72a6306811 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:21.670897 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-44276173-037d-4713-b169-be72a6306811 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1260 microversion: 2.1 time: 0.157254 Aug 26 16:04:21.671486 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 566/1137] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:21 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:22.691517 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a94da782-b981-40d9-aff0-5fa3f53380d9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:22.692150 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a94da782-b981-40d9-aff0-5fa3f53380d9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:22.694003 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:22.694736 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell0:SELECT=6 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:22.700407 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a94da782-b981-40d9-aff0-5fa3f53380d9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:22.700889 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a94da782-b981-40d9-aff0-5fa3f53380d9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:22.701327 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a94da782-b981-40d9-aff0-5fa3f53380d9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:22.702055 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a94da782-b981-40d9-aff0-5fa3f53380d9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:22.702506 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a94da782-b981-40d9-aff0-5fa3f53380d9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:22.702928 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a94da782-b981-40d9-aff0-5fa3f53380d9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:22.838197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a94da782-b981-40d9-aff0-5fa3f53380d9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:22.846071 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a94da782-b981-40d9-aff0-5fa3f53380d9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1260 microversion: 2.1 time: 0.158510 Aug 26 16:04:22.846635 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 572/1138] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:22 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:23.866738 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c4c077b0-bc93-4ad6-9f62-5fd4f8862312 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:23.867296 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-c4c077b0-bc93-4ad6-9f62-5fd4f8862312 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:23.873826 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c4c077b0-bc93-4ad6-9f62-5fd4f8862312 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:23.874302 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c4c077b0-bc93-4ad6-9f62-5fd4f8862312 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:23.874728 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c4c077b0-bc93-4ad6-9f62-5fd4f8862312 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:23.875405 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c4c077b0-bc93-4ad6-9f62-5fd4f8862312 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:23.875848 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c4c077b0-bc93-4ad6-9f62-5fd4f8862312 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:23.876291 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-c4c077b0-bc93-4ad6-9f62-5fd4f8862312 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:24.010033 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-c4c077b0-bc93-4ad6-9f62-5fd4f8862312 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:24.017922 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c4c077b0-bc93-4ad6-9f62-5fd4f8862312 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1260 microversion: 2.1 time: 0.155323 Aug 26 16:04:24.018497 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 567/1139] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:23 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:25.039063 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-5724a7ee-7728-4f3e-aca5-0d74bdb86e83 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:25.039690 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-5724a7ee-7728-4f3e-aca5-0d74bdb86e83 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:25.046769 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5724a7ee-7728-4f3e-aca5-0d74bdb86e83 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:25.047251 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5724a7ee-7728-4f3e-aca5-0d74bdb86e83 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:25.047690 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5724a7ee-7728-4f3e-aca5-0d74bdb86e83 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:25.048420 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5724a7ee-7728-4f3e-aca5-0d74bdb86e83 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:25.048871 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5724a7ee-7728-4f3e-aca5-0d74bdb86e83 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:25.049293 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-5724a7ee-7728-4f3e-aca5-0d74bdb86e83 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:25.192040 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-5724a7ee-7728-4f3e-aca5-0d74bdb86e83 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:25.200341 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-5724a7ee-7728-4f3e-aca5-0d74bdb86e83 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1260 microversion: 2.1 time: 0.165028 Aug 26 16:04:25.200998 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 573/1140] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:25 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:26.221491 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-65e43f41-2350-403d-90df-d5dad8cdb706 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:26.222781 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-65e43f41-2350-403d-90df-d5dad8cdb706 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:26.229353 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65e43f41-2350-403d-90df-d5dad8cdb706 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:26.229836 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65e43f41-2350-403d-90df-d5dad8cdb706 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:26.230270 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65e43f41-2350-403d-90df-d5dad8cdb706 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:26.230971 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65e43f41-2350-403d-90df-d5dad8cdb706 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:26.231420 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65e43f41-2350-403d-90df-d5dad8cdb706 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:26.231917 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-65e43f41-2350-403d-90df-d5dad8cdb706 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:26.366217 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-65e43f41-2350-403d-90df-d5dad8cdb706 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:26.374602 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-65e43f41-2350-403d-90df-d5dad8cdb706 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1260 microversion: 2.1 time: 0.157019 Aug 26 16:04:26.375166 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 568/1141] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:26 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:27.396148 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-bed5022c-5b47-45c5-895a-2c65db5033d5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:27.396788 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-bed5022c-5b47-45c5-895a-2c65db5033d5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:27.403153 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bed5022c-5b47-45c5-895a-2c65db5033d5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:27.403620 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bed5022c-5b47-45c5-895a-2c65db5033d5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:27.404117 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bed5022c-5b47-45c5-895a-2c65db5033d5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:27.404798 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bed5022c-5b47-45c5-895a-2c65db5033d5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:27.405732 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bed5022c-5b47-45c5-895a-2c65db5033d5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:27.406151 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-bed5022c-5b47-45c5-895a-2c65db5033d5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:27.547545 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-bed5022c-5b47-45c5-895a-2c65db5033d5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:27.555332 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-bed5022c-5b47-45c5-895a-2c65db5033d5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1260 microversion: 2.1 time: 0.163016 Aug 26 16:04:27.555930 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 574/1142] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:27 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:27.741865 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-a0e239c2-f547-47dd-96e6-80b5ebd1ac3e req-ff1d73c1-f8ec-4de1-b0fe-b2893ea72f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85bcd3d4-0eae-48e0-9877-b62bab4470b8", "name": "network-vif-plugged", "status": "completed", "tag": "b6648bb5-3c8b-4235-b7db-d22730f77068"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:27.751588 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-a0e239c2-f547-47dd-96e6-80b5ebd1ac3e req-ff1d73c1-f8ec-4de1-b0fe-b2893ea72f74 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:27.752118 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-a0e239c2-f547-47dd-96e6-80b5ebd1ac3e req-ff1d73c1-f8ec-4de1-b0fe-b2893ea72f74 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:27.752552 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-a0e239c2-f547-47dd-96e6-80b5ebd1ac3e req-ff1d73c1-f8ec-4de1-b0fe-b2893ea72f74 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:27.763763 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-a0e239c2-f547-47dd-96e6-80b5ebd1ac3e req-ff1d73c1-f8ec-4de1-b0fe-b2893ea72f74 service nova] Creating event network-vif-plugged:b6648bb5-3c8b-4235-b7db-d22730f77068 for instance 85bcd3d4-0eae-48e0-9877-b62bab4470b8 on hv-cinder-83124 Aug 26 16:04:27.768803 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-a0e239c2-f547-47dd-96e6-80b5ebd1ac3e req-ff1d73c1-f8ec-4de1-b0fe-b2893ea72f74 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030602 Aug 26 16:04:27.769421 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 569/1143] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:28.576770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-8128c01e-061d-4d39-9ccd-c800a318afd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:28.577393 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-8128c01e-061d-4d39-9ccd-c800a318afd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:28.583998 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8128c01e-061d-4d39-9ccd-c800a318afd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:28.584478 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8128c01e-061d-4d39-9ccd-c800a318afd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:28.584911 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8128c01e-061d-4d39-9ccd-c800a318afd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:28.585598 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8128c01e-061d-4d39-9ccd-c800a318afd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:28.586046 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8128c01e-061d-4d39-9ccd-c800a318afd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:28.586466 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-8128c01e-061d-4d39-9ccd-c800a318afd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:28.720955 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-8128c01e-061d-4d39-9ccd-c800a318afd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:28.728715 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-8128c01e-061d-4d39-9ccd-c800a318afd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1260 microversion: 2.1 time: 0.155948 Aug 26 16:04:28.729281 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 575/1144] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:28 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:29.751340 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0f4f3602-d095-4c96-8685-23979722ebff tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:29.752068 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0f4f3602-d095-4c96-8685-23979722ebff tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:29.758419 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f4f3602-d095-4c96-8685-23979722ebff tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:29.758909 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f4f3602-d095-4c96-8685-23979722ebff tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:29.759345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f4f3602-d095-4c96-8685-23979722ebff tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:29.760072 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f4f3602-d095-4c96-8685-23979722ebff tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:29.760523 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f4f3602-d095-4c96-8685-23979722ebff tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:29.760944 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0f4f3602-d095-4c96-8685-23979722ebff tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:29.892609 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0f4f3602-d095-4c96-8685-23979722ebff tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:29.900227 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0f4f3602-d095-4c96-8685-23979722ebff tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1444 microversion: 2.1 time: 0.154366 Aug 26 16:04:29.900796 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 570/1145] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:29 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:29.919700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-019ec28e-f5f1-44a9-b583-affae6b57742 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:29.920331 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-019ec28e-f5f1-44a9-b583-affae6b57742 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:29.926944 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-019ec28e-f5f1-44a9-b583-affae6b57742 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:29.927407 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-019ec28e-f5f1-44a9-b583-affae6b57742 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:29.928015 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-019ec28e-f5f1-44a9-b583-affae6b57742 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:29.929146 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-019ec28e-f5f1-44a9-b583-affae6b57742 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:29.929975 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-019ec28e-f5f1-44a9-b583-affae6b57742 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:29.930741 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-019ec28e-f5f1-44a9-b583-affae6b57742 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:30.064349 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-019ec28e-f5f1-44a9-b583-affae6b57742 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:30.072252 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-019ec28e-f5f1-44a9-b583-affae6b57742 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1444 microversion: 2.1 time: 0.156344 Aug 26 16:04:30.072913 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 576/1146] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:29 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:32.446651 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-f04cbd8b-d639-417b-88e1-01038bf0708e req-62abda31-5280-4b7f-a465-a44881c1ca4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85bcd3d4-0eae-48e0-9877-b62bab4470b8", "tag": "b6648bb5-3c8b-4235-b7db-d22730f77068"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:32.456144 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-f04cbd8b-d639-417b-88e1-01038bf0708e req-62abda31-5280-4b7f-a465-a44881c1ca4f service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:32.456626 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-f04cbd8b-d639-417b-88e1-01038bf0708e req-62abda31-5280-4b7f-a465-a44881c1ca4f service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:32.457060 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-f04cbd8b-d639-417b-88e1-01038bf0708e req-62abda31-5280-4b7f-a465-a44881c1ca4f service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:32.468032 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-f04cbd8b-d639-417b-88e1-01038bf0708e req-62abda31-5280-4b7f-a465-a44881c1ca4f service nova] Creating event network-changed:b6648bb5-3c8b-4235-b7db-d22730f77068 for instance 85bcd3d4-0eae-48e0-9877-b62bab4470b8 on hv-cinder-83124 Aug 26 16:04:32.473345 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-f04cbd8b-d639-417b-88e1-01038bf0708e req-62abda31-5280-4b7f-a465-a44881c1ca4f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090786 Aug 26 16:04:32.474252 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 571/1147] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:06:27.362554 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:06:27.363355 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=62 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:06:27.364643 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 26 16:06:27.364793 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Fri Aug 26 16:06:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8/action (ip 10.222.0.98) !!! Aug 26 16:06:27.365887 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 16:06:27.366021 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Fri Aug 26 16:06:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8/action (ip 10.222.0.98) !!! Aug 26 16:06:27.371175 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-1b67ef77-5dd1-4240-aac0-7afb20d89796 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:06:27.371752 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-1b67ef77-5dd1-4240-aac0-7afb20d89796 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:27.380329 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b67ef77-5dd1-4240-aac0-7afb20d89796 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:27.380811 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b67ef77-5dd1-4240-aac0-7afb20d89796 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:27.381249 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b67ef77-5dd1-4240-aac0-7afb20d89796 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:27.381968 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b67ef77-5dd1-4240-aac0-7afb20d89796 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:27.382481 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b67ef77-5dd1-4240-aac0-7afb20d89796 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:27.382912 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-1b67ef77-5dd1-4240-aac0-7afb20d89796 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:27.407218 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.objects.instance [None req-1b67ef77-5dd1-4240-aac0-7afb20d89796 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lazy-loading 'flavor' on Instance uuid 85bcd3d4-0eae-48e0-9877-b62bab4470b8 {{(pid=127697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:06:27.795424 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-1b67ef77-5dd1-4240-aac0-7afb20d89796 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "POST /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8/action" status: 202 len: 0 microversion: 2.1 time: 0.434604 Aug 26 16:06:27.796045 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 577/1148] 10.222.0.98 () {60 vars in 1278 bytes} [Fri Aug 26 16:06:27 2022] POST /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:06:27.803305 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [07ee31bd-7e26-4931-b0f3-4d151115699b] AMQP server on 10.222.0.98:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 26 16:06:27.804007 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=24 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:06:27.804756 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=48 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:06:27.806002 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 26 16:06:27.806146 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Fri Aug 26 16:06:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 (ip 10.222.0.98) !!! Aug 26 16:06:27.811367 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-8e9bf778-3b67-43f5-9fac-6798a001399d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:27.812112 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-8e9bf778-3b67-43f5-9fac-6798a001399d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:27.820772 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8e9bf778-3b67-43f5-9fac-6798a001399d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:27.821318 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8e9bf778-3b67-43f5-9fac-6798a001399d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:27.822012 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8e9bf778-3b67-43f5-9fac-6798a001399d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:27.822709 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8e9bf778-3b67-43f5-9fac-6798a001399d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:27.823161 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8e9bf778-3b67-43f5-9fac-6798a001399d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:27.823593 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-8e9bf778-3b67-43f5-9fac-6798a001399d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:28.014788 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-8e9bf778-3b67-43f5-9fac-6798a001399d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:28.022615 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-8e9bf778-3b67-43f5-9fac-6798a001399d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1568 microversion: 2.1 time: 0.221472 Aug 26 16:06:28.023179 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 572/1149] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:27 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:29.045065 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0ee2d3f6-c5bf-4e02-adf1-ff970d0f3e5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:29.045761 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0ee2d3f6-c5bf-4e02-adf1-ff970d0f3e5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:29.052649 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ee2d3f6-c5bf-4e02-adf1-ff970d0f3e5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:29.053128 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ee2d3f6-c5bf-4e02-adf1-ff970d0f3e5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:29.053592 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ee2d3f6-c5bf-4e02-adf1-ff970d0f3e5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:29.054252 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ee2d3f6-c5bf-4e02-adf1-ff970d0f3e5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:29.054701 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ee2d3f6-c5bf-4e02-adf1-ff970d0f3e5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:29.055134 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0ee2d3f6-c5bf-4e02-adf1-ff970d0f3e5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:29.239853 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0ee2d3f6-c5bf-4e02-adf1-ff970d0f3e5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:29.248018 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0ee2d3f6-c5bf-4e02-adf1-ff970d0f3e5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1568 microversion: 2.1 time: 0.207828 Aug 26 16:06:29.248593 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 578/1150] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:29 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:30.270316 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2964c7c9-1f80-4d55-a52c-74ef6dac5383 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:30.270949 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2964c7c9-1f80-4d55-a52c-74ef6dac5383 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:30.278804 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2964c7c9-1f80-4d55-a52c-74ef6dac5383 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:30.279339 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2964c7c9-1f80-4d55-a52c-74ef6dac5383 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:30.279796 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2964c7c9-1f80-4d55-a52c-74ef6dac5383 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:30.280540 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2964c7c9-1f80-4d55-a52c-74ef6dac5383 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:30.281003 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2964c7c9-1f80-4d55-a52c-74ef6dac5383 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:30.281456 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2964c7c9-1f80-4d55-a52c-74ef6dac5383 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:30.287082 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO oslo.messaging._drivers.impl_rabbit [-] [07ee31bd-7e26-4931-b0f3-4d151115699b] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 51532. Aug 26 16:06:30.414595 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2964c7c9-1f80-4d55-a52c-74ef6dac5383 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:30.422631 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2964c7c9-1f80-4d55-a52c-74ef6dac5383 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1568 microversion: 2.1 time: 0.156782 Aug 26 16:06:30.423196 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 573/1151] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:30 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:31.444576 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f7d7e42c-9938-453c-b187-c6b8c41730df tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:31.455657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f7d7e42c-9938-453c-b187-c6b8c41730df tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:31.455657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f7d7e42c-9938-453c-b187-c6b8c41730df tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:31.455657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f7d7e42c-9938-453c-b187-c6b8c41730df tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:31.455657 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f7d7e42c-9938-453c-b187-c6b8c41730df tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:31.456150 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f7d7e42c-9938-453c-b187-c6b8c41730df tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:31.456150 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f7d7e42c-9938-453c-b187-c6b8c41730df tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:31.456150 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f7d7e42c-9938-453c-b187-c6b8c41730df tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:31.591320 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f7d7e42c-9938-453c-b187-c6b8c41730df tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:31.600320 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f7d7e42c-9938-453c-b187-c6b8c41730df tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1568 microversion: 2.1 time: 0.159646 Aug 26 16:06:31.604492 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 579/1152] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:31 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:32.621760 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-57f01b2e-f8a8-41fe-ad21-fd87271266a9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:32.622370 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-57f01b2e-f8a8-41fe-ad21-fd87271266a9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:32.628944 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-57f01b2e-f8a8-41fe-ad21-fd87271266a9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:32.629425 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-57f01b2e-f8a8-41fe-ad21-fd87271266a9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:32.629863 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-57f01b2e-f8a8-41fe-ad21-fd87271266a9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:32.630546 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-57f01b2e-f8a8-41fe-ad21-fd87271266a9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:32.630994 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-57f01b2e-f8a8-41fe-ad21-fd87271266a9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:32.631414 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-57f01b2e-f8a8-41fe-ad21-fd87271266a9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:32.762800 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-57f01b2e-f8a8-41fe-ad21-fd87271266a9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:32.771045 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-57f01b2e-f8a8-41fe-ad21-fd87271266a9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1568 microversion: 2.1 time: 0.153246 Aug 26 16:06:32.771625 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 574/1153] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:32 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:33.792812 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-31b207be-d287-4222-8e0f-4ea0bce7ed3c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:33.793420 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-31b207be-d287-4222-8e0f-4ea0bce7ed3c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:33.800368 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-31b207be-d287-4222-8e0f-4ea0bce7ed3c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:33.800849 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-31b207be-d287-4222-8e0f-4ea0bce7ed3c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:33.801282 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-31b207be-d287-4222-8e0f-4ea0bce7ed3c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:33.801971 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-31b207be-d287-4222-8e0f-4ea0bce7ed3c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:33.802420 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-31b207be-d287-4222-8e0f-4ea0bce7ed3c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:33.802893 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-31b207be-d287-4222-8e0f-4ea0bce7ed3c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:33.935694 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-31b207be-d287-4222-8e0f-4ea0bce7ed3c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:33.943344 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-31b207be-d287-4222-8e0f-4ea0bce7ed3c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1568 microversion: 2.1 time: 0.154445 Aug 26 16:06:33.943918 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 580/1154] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:33 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:34.963893 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-b734b181-b860-482f-9bf8-d4f00fc54a5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:34.964512 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-b734b181-b860-482f-9bf8-d4f00fc54a5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:34.971574 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b734b181-b860-482f-9bf8-d4f00fc54a5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:34.972109 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b734b181-b860-482f-9bf8-d4f00fc54a5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:34.972549 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b734b181-b860-482f-9bf8-d4f00fc54a5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:34.973233 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b734b181-b860-482f-9bf8-d4f00fc54a5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:34.973687 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b734b181-b860-482f-9bf8-d4f00fc54a5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:34.974111 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-b734b181-b860-482f-9bf8-d4f00fc54a5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:35.104307 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-b734b181-b860-482f-9bf8-d4f00fc54a5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:35.112508 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-b734b181-b860-482f-9bf8-d4f00fc54a5f tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1568 microversion: 2.1 time: 0.152561 Aug 26 16:06:35.113076 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 575/1155] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:34 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:36.133749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-6d364e73-2102-4482-94f6-9701ddf35bf2 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:36.134481 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-6d364e73-2102-4482-94f6-9701ddf35bf2 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:36.140886 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6d364e73-2102-4482-94f6-9701ddf35bf2 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:36.141362 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6d364e73-2102-4482-94f6-9701ddf35bf2 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:36.141801 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6d364e73-2102-4482-94f6-9701ddf35bf2 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:36.143058 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6d364e73-2102-4482-94f6-9701ddf35bf2 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:36.143508 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6d364e73-2102-4482-94f6-9701ddf35bf2 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:36.143956 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-6d364e73-2102-4482-94f6-9701ddf35bf2 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:36.275160 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-6d364e73-2102-4482-94f6-9701ddf35bf2 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:36.282955 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-6d364e73-2102-4482-94f6-9701ddf35bf2 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1568 microversion: 2.1 time: 0.153304 Aug 26 16:06:36.283516 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 581/1156] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:36 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:37.304648 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-3ab01ef2-77ef-4662-8a3c-557b1ca5dd80 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:37.305407 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-3ab01ef2-77ef-4662-8a3c-557b1ca5dd80 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:37.311707 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ab01ef2-77ef-4662-8a3c-557b1ca5dd80 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:37.312222 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ab01ef2-77ef-4662-8a3c-557b1ca5dd80 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:37.312656 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ab01ef2-77ef-4662-8a3c-557b1ca5dd80 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:37.313347 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ab01ef2-77ef-4662-8a3c-557b1ca5dd80 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:37.313797 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ab01ef2-77ef-4662-8a3c-557b1ca5dd80 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:37.314222 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-3ab01ef2-77ef-4662-8a3c-557b1ca5dd80 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:37.455582 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-3ab01ef2-77ef-4662-8a3c-557b1ca5dd80 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:37.463297 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-3ab01ef2-77ef-4662-8a3c-557b1ca5dd80 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1568 microversion: 2.1 time: 0.162617 Aug 26 16:06:37.463862 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 576/1157] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:37 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:38.484770 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-22ff6b9f-26b6-4790-a0d3-d29159751be1 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:38.486433 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-22ff6b9f-26b6-4790-a0d3-d29159751be1 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:38.491757 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-22ff6b9f-26b6-4790-a0d3-d29159751be1 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:38.492292 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-22ff6b9f-26b6-4790-a0d3-d29159751be1 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:38.492727 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-22ff6b9f-26b6-4790-a0d3-d29159751be1 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:38.493428 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-22ff6b9f-26b6-4790-a0d3-d29159751be1 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:38.493878 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-22ff6b9f-26b6-4790-a0d3-d29159751be1 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:38.494300 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-22ff6b9f-26b6-4790-a0d3-d29159751be1 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:38.631184 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-22ff6b9f-26b6-4790-a0d3-d29159751be1 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:38.639021 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-22ff6b9f-26b6-4790-a0d3-d29159751be1 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1568 microversion: 2.1 time: 0.158147 Aug 26 16:06:38.639782 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 582/1158] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:38 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:39.660337 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-4991f42f-0f27-4b25-aa9a-d1609bc899a8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:39.661047 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-4991f42f-0f27-4b25-aa9a-d1609bc899a8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:39.667845 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4991f42f-0f27-4b25-aa9a-d1609bc899a8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:39.668358 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4991f42f-0f27-4b25-aa9a-d1609bc899a8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:39.668793 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4991f42f-0f27-4b25-aa9a-d1609bc899a8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:39.669487 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4991f42f-0f27-4b25-aa9a-d1609bc899a8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:39.669937 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4991f42f-0f27-4b25-aa9a-d1609bc899a8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:39.670361 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-4991f42f-0f27-4b25-aa9a-d1609bc899a8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:39.800709 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-4991f42f-0f27-4b25-aa9a-d1609bc899a8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:39.808360 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-4991f42f-0f27-4b25-aa9a-d1609bc899a8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1568 microversion: 2.1 time: 0.151881 Aug 26 16:06:39.808930 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 577/1159] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:39 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:40.831540 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-86bdf915-e2fd-4c39-8d99-3fd97531c920 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:40.833839 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-86bdf915-e2fd-4c39-8d99-3fd97531c920 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:40.838782 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-86bdf915-e2fd-4c39-8d99-3fd97531c920 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:40.839263 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-86bdf915-e2fd-4c39-8d99-3fd97531c920 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:40.839758 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-86bdf915-e2fd-4c39-8d99-3fd97531c920 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:40.840475 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-86bdf915-e2fd-4c39-8d99-3fd97531c920 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:40.840929 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-86bdf915-e2fd-4c39-8d99-3fd97531c920 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:40.841353 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-86bdf915-e2fd-4c39-8d99-3fd97531c920 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:40.976022 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-86bdf915-e2fd-4c39-8d99-3fd97531c920 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:40.984161 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-86bdf915-e2fd-4c39-8d99-3fd97531c920 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1568 microversion: 2.1 time: 0.156797 Aug 26 16:06:40.985267 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 583/1160] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:40 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:42.006384 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0218e356-bf6a-4c1d-ad97-bb5c2ccb6ca0 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:42.007004 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0218e356-bf6a-4c1d-ad97-bb5c2ccb6ca0 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:42.013464 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0218e356-bf6a-4c1d-ad97-bb5c2ccb6ca0 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:42.013944 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0218e356-bf6a-4c1d-ad97-bb5c2ccb6ca0 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:42.014376 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0218e356-bf6a-4c1d-ad97-bb5c2ccb6ca0 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:42.015061 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0218e356-bf6a-4c1d-ad97-bb5c2ccb6ca0 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:42.015510 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0218e356-bf6a-4c1d-ad97-bb5c2ccb6ca0 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:42.015958 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0218e356-bf6a-4c1d-ad97-bb5c2ccb6ca0 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:42.151888 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0218e356-bf6a-4c1d-ad97-bb5c2ccb6ca0 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:42.160498 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0218e356-bf6a-4c1d-ad97-bb5c2ccb6ca0 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1569 microversion: 2.1 time: 0.158183 Aug 26 16:06:42.161067 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 578/1161] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:42 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:42.180391 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-fc0b0238-54c2-4c0e-be52-043742708701 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:06:42.180995 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-fc0b0238-54c2-4c0e-be52-043742708701 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:42.187425 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fc0b0238-54c2-4c0e-be52-043742708701 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:42.187939 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fc0b0238-54c2-4c0e-be52-043742708701 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:42.188379 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fc0b0238-54c2-4c0e-be52-043742708701 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:42.189102 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fc0b0238-54c2-4c0e-be52-043742708701 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:42.189556 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fc0b0238-54c2-4c0e-be52-043742708701 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:42.189980 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fc0b0238-54c2-4c0e-be52-043742708701 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:42.219289 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-fc0b0238-54c2-4c0e-be52-043742708701 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127697) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 16:06:42.587017 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-fc0b0238-54c2-4c0e-be52-043742708701 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "POST /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8/action" status: 202 len: 0 microversion: 2.1 time: 0.410305 Aug 26 16:06:42.587494 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 584/1162] 10.222.0.98 () {60 vars in 1278 bytes} [Fri Aug 26 16:06:42 2022] POST /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:06:42.595505 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-5080fc6a-9223-4c82-a382-a7cf6e76e215 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:42.602111 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-5080fc6a-9223-4c82-a382-a7cf6e76e215 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:42.602111 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5080fc6a-9223-4c82-a382-a7cf6e76e215 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:42.603081 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5080fc6a-9223-4c82-a382-a7cf6e76e215 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:42.603181 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5080fc6a-9223-4c82-a382-a7cf6e76e215 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:42.604046 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5080fc6a-9223-4c82-a382-a7cf6e76e215 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:42.604430 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5080fc6a-9223-4c82-a382-a7cf6e76e215 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:42.604843 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-5080fc6a-9223-4c82-a382-a7cf6e76e215 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:42.735244 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-5080fc6a-9223-4c82-a382-a7cf6e76e215 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:42.747516 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-5080fc6a-9223-4c82-a382-a7cf6e76e215 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1517 microversion: 2.1 time: 0.155829 Aug 26 16:06:42.748134 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 579/1163] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:42 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:43.769494 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-45a59cdb-a6fb-4f1c-929f-2c58ba2bd576 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:43.770213 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-45a59cdb-a6fb-4f1c-929f-2c58ba2bd576 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:43.776181 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-45a59cdb-a6fb-4f1c-929f-2c58ba2bd576 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:43.776654 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-45a59cdb-a6fb-4f1c-929f-2c58ba2bd576 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:43.778049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-45a59cdb-a6fb-4f1c-929f-2c58ba2bd576 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:43.778049 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-45a59cdb-a6fb-4f1c-929f-2c58ba2bd576 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:43.778284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-45a59cdb-a6fb-4f1c-929f-2c58ba2bd576 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:43.778610 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-45a59cdb-a6fb-4f1c-929f-2c58ba2bd576 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:43.912469 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-45a59cdb-a6fb-4f1c-929f-2c58ba2bd576 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:43.920197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-45a59cdb-a6fb-4f1c-929f-2c58ba2bd576 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1517 microversion: 2.1 time: 0.155529 Aug 26 16:06:43.920763 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 585/1164] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:43 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:44.371306 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-9c4de680-bdf4-45d7-86c9-11b6d6c7d41b req-4868e9ce-54cd-47d7-90e8-fb5aa0b03124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85bcd3d4-0eae-48e0-9877-b62bab4470b8", "name": "network-vif-unplugged", "status": "completed", "tag": "b6648bb5-3c8b-4235-b7db-d22730f77068"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:06:44.381496 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-9c4de680-bdf4-45d7-86c9-11b6d6c7d41b req-4868e9ce-54cd-47d7-90e8-fb5aa0b03124 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:44.381967 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-9c4de680-bdf4-45d7-86c9-11b6d6c7d41b req-4868e9ce-54cd-47d7-90e8-fb5aa0b03124 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:44.382395 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-9c4de680-bdf4-45d7-86c9-11b6d6c7d41b req-4868e9ce-54cd-47d7-90e8-fb5aa0b03124 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:44.393459 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.compute.server_external_events [req-9c4de680-bdf4-45d7-86c9-11b6d6c7d41b req-4868e9ce-54cd-47d7-90e8-fb5aa0b03124 service nova] Unable to find a host for instance 85bcd3d4-0eae-48e0-9877-b62bab4470b8. Dropping event network-vif-unplugged {{(pid=127698) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 26 16:06:44.394323 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-9c4de680-bdf4-45d7-86c9-11b6d6c7d41b req-4868e9ce-54cd-47d7-90e8-fb5aa0b03124 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027488 Aug 26 16:06:44.394897 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 580/1165] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 26 16:06:44.942779 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-fe21dc14-5092-4c5b-9178-9407f5d55675 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:44.943382 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-fe21dc14-5092-4c5b-9178-9407f5d55675 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:44.950440 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fe21dc14-5092-4c5b-9178-9407f5d55675 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:44.950928 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fe21dc14-5092-4c5b-9178-9407f5d55675 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:44.951363 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fe21dc14-5092-4c5b-9178-9407f5d55675 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:44.952102 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fe21dc14-5092-4c5b-9178-9407f5d55675 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:44.952608 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fe21dc14-5092-4c5b-9178-9407f5d55675 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:44.953034 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-fe21dc14-5092-4c5b-9178-9407f5d55675 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:45.090750 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-fe21dc14-5092-4c5b-9178-9407f5d55675 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:45.098502 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-fe21dc14-5092-4c5b-9178-9407f5d55675 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1519 microversion: 2.1 time: 0.160228 Aug 26 16:06:45.099076 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 586/1166] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:44 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:46.120401 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-7fe98a3f-1853-46e5-b510-6fcbb1a20395 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:46.121016 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-7fe98a3f-1853-46e5-b510-6fcbb1a20395 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:46.128476 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7fe98a3f-1853-46e5-b510-6fcbb1a20395 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:46.128987 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7fe98a3f-1853-46e5-b510-6fcbb1a20395 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:46.129425 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7fe98a3f-1853-46e5-b510-6fcbb1a20395 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:46.130123 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7fe98a3f-1853-46e5-b510-6fcbb1a20395 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:46.130737 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7fe98a3f-1853-46e5-b510-6fcbb1a20395 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:46.131162 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-7fe98a3f-1853-46e5-b510-6fcbb1a20395 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:46.330908 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-7fe98a3f-1853-46e5-b510-6fcbb1a20395 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:46.339297 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-7fe98a3f-1853-46e5-b510-6fcbb1a20395 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1575 microversion: 2.1 time: 0.222884 Aug 26 16:06:46.339888 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 581/1167] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:46 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:47.361173 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-f40d7528-f833-4a51-83d1-e69b92b685ba tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:47.361774 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-f40d7528-f833-4a51-83d1-e69b92b685ba tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:47.368206 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f40d7528-f833-4a51-83d1-e69b92b685ba tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:47.368687 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f40d7528-f833-4a51-83d1-e69b92b685ba tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:47.369126 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f40d7528-f833-4a51-83d1-e69b92b685ba tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:47.369820 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f40d7528-f833-4a51-83d1-e69b92b685ba tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:47.370266 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f40d7528-f833-4a51-83d1-e69b92b685ba tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:47.370689 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-f40d7528-f833-4a51-83d1-e69b92b685ba tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:47.503574 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-f40d7528-f833-4a51-83d1-e69b92b685ba tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:47.511534 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-f40d7528-f833-4a51-83d1-e69b92b685ba tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1575 microversion: 2.1 time: 0.154726 Aug 26 16:06:47.512214 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 587/1168] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:47 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:48.533254 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-2f8f6e1f-197e-4255-a2f5-aa76778e57f5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:48.533861 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-2f8f6e1f-197e-4255-a2f5-aa76778e57f5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:48.540339 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f8f6e1f-197e-4255-a2f5-aa76778e57f5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:48.540815 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f8f6e1f-197e-4255-a2f5-aa76778e57f5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:48.541249 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f8f6e1f-197e-4255-a2f5-aa76778e57f5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:48.541963 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f8f6e1f-197e-4255-a2f5-aa76778e57f5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:48.542407 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f8f6e1f-197e-4255-a2f5-aa76778e57f5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:48.542841 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-2f8f6e1f-197e-4255-a2f5-aa76778e57f5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:48.672425 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-2f8f6e1f-197e-4255-a2f5-aa76778e57f5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:48.680562 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-2f8f6e1f-197e-4255-a2f5-aa76778e57f5 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1575 microversion: 2.1 time: 0.151809 Aug 26 16:06:48.681114 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 582/1169] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:48 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:49.701843 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-da4f95b8-d262-42e7-b13d-1a3a3172ba9d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:49.702427 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-da4f95b8-d262-42e7-b13d-1a3a3172ba9d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:49.708964 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-da4f95b8-d262-42e7-b13d-1a3a3172ba9d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:49.709435 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-da4f95b8-d262-42e7-b13d-1a3a3172ba9d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:49.709860 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-da4f95b8-d262-42e7-b13d-1a3a3172ba9d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:49.710547 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-da4f95b8-d262-42e7-b13d-1a3a3172ba9d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:49.710988 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-da4f95b8-d262-42e7-b13d-1a3a3172ba9d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:49.711403 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-da4f95b8-d262-42e7-b13d-1a3a3172ba9d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:49.842364 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-da4f95b8-d262-42e7-b13d-1a3a3172ba9d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:49.850700 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-da4f95b8-d262-42e7-b13d-1a3a3172ba9d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1575 microversion: 2.1 time: 0.152689 Aug 26 16:06:49.851260 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 588/1170] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:49 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:50.872696 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-ad9df4ac-8862-4c94-b9d6-006f73145476 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:50.873265 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-ad9df4ac-8862-4c94-b9d6-006f73145476 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:50.879733 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ad9df4ac-8862-4c94-b9d6-006f73145476 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:50.880253 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ad9df4ac-8862-4c94-b9d6-006f73145476 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:50.880693 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ad9df4ac-8862-4c94-b9d6-006f73145476 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:50.881381 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ad9df4ac-8862-4c94-b9d6-006f73145476 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:50.881844 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ad9df4ac-8862-4c94-b9d6-006f73145476 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:50.882295 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-ad9df4ac-8862-4c94-b9d6-006f73145476 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:51.017111 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-ad9df4ac-8862-4c94-b9d6-006f73145476 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:51.024819 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-ad9df4ac-8862-4c94-b9d6-006f73145476 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1575 microversion: 2.1 time: 0.156126 Aug 26 16:06:51.025395 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 583/1171] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:50 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:52.045742 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-296289ba-48d5-47af-afc3-0ee870d357f7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:52.046359 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-296289ba-48d5-47af-afc3-0ee870d357f7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:52.053268 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-296289ba-48d5-47af-afc3-0ee870d357f7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:52.053750 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-296289ba-48d5-47af-afc3-0ee870d357f7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:52.054190 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-296289ba-48d5-47af-afc3-0ee870d357f7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:52.054875 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-296289ba-48d5-47af-afc3-0ee870d357f7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:52.055325 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-296289ba-48d5-47af-afc3-0ee870d357f7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:52.055749 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-296289ba-48d5-47af-afc3-0ee870d357f7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:52.187637 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-296289ba-48d5-47af-afc3-0ee870d357f7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:52.195854 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-296289ba-48d5-47af-afc3-0ee870d357f7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1575 microversion: 2.1 time: 0.153993 Aug 26 16:06:52.196439 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 589/1172] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:52 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:53.217683 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a9c422d1-8b90-4424-b445-d4974f1a378d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:53.218287 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a9c422d1-8b90-4424-b445-d4974f1a378d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:53.227084 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a9c422d1-8b90-4424-b445-d4974f1a378d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:53.227558 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a9c422d1-8b90-4424-b445-d4974f1a378d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:53.228034 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a9c422d1-8b90-4424-b445-d4974f1a378d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:53.228730 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a9c422d1-8b90-4424-b445-d4974f1a378d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:53.229217 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a9c422d1-8b90-4424-b445-d4974f1a378d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:53.229723 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a9c422d1-8b90-4424-b445-d4974f1a378d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:53.360237 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-a9c422d1-8b90-4424-b445-d4974f1a378d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:53.368309 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-a9c422d1-8b90-4424-b445-d4974f1a378d tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1575 microversion: 2.1 time: 0.154428 Aug 26 16:06:53.368822 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 584/1173] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:53 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:54.389573 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-0a8a489e-658c-42ee-8fa2-0999677e0a89 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:54.390145 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-0a8a489e-658c-42ee-8fa2-0999677e0a89 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:54.396777 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a8a489e-658c-42ee-8fa2-0999677e0a89 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:54.397254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a8a489e-658c-42ee-8fa2-0999677e0a89 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:54.397690 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a8a489e-658c-42ee-8fa2-0999677e0a89 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:54.398388 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a8a489e-658c-42ee-8fa2-0999677e0a89 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:54.398840 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a8a489e-658c-42ee-8fa2-0999677e0a89 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:54.399265 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-0a8a489e-658c-42ee-8fa2-0999677e0a89 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:54.418191 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:06:54.533558 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-0a8a489e-658c-42ee-8fa2-0999677e0a89 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:54.541358 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-0a8a489e-658c-42ee-8fa2-0999677e0a89 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1575 microversion: 2.1 time: 0.155832 Aug 26 16:06:54.541924 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 590/1174] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:54 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:55.563114 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-0cf7c6a8-52d4-4aa8-b2d1-d20bdd2722cd tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:55.564360 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-0cf7c6a8-52d4-4aa8-b2d1-d20bdd2722cd tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:55.571500 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0cf7c6a8-52d4-4aa8-b2d1-d20bdd2722cd tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:55.572027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0cf7c6a8-52d4-4aa8-b2d1-d20bdd2722cd tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:55.572719 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0cf7c6a8-52d4-4aa8-b2d1-d20bdd2722cd tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:55.573421 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0cf7c6a8-52d4-4aa8-b2d1-d20bdd2722cd tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:55.573867 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0cf7c6a8-52d4-4aa8-b2d1-d20bdd2722cd tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:55.574286 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-0cf7c6a8-52d4-4aa8-b2d1-d20bdd2722cd tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:55.711195 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-0cf7c6a8-52d4-4aa8-b2d1-d20bdd2722cd tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:55.719072 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-0cf7c6a8-52d4-4aa8-b2d1-d20bdd2722cd tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1575 microversion: 2.1 time: 0.160194 Aug 26 16:06:55.719647 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 585/1175] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:55 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:56.448661 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-02805f9e-cdfb-4723-ba27-a8630285b594 req-c84f3777-db25-4cf9-86c8-0d6653b314b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85bcd3d4-0eae-48e0-9877-b62bab4470b8", "name": "network-vif-plugged", "status": "completed", "tag": "b6648bb5-3c8b-4235-b7db-d22730f77068"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:06:56.460014 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-02805f9e-cdfb-4723-ba27-a8630285b594 req-c84f3777-db25-4cf9-86c8-0d6653b314b0 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:56.460513 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-02805f9e-cdfb-4723-ba27-a8630285b594 req-c84f3777-db25-4cf9-86c8-0d6653b314b0 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:56.461040 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-02805f9e-cdfb-4723-ba27-a8630285b594 req-c84f3777-db25-4cf9-86c8-0d6653b314b0 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:56.472267 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-02805f9e-cdfb-4723-ba27-a8630285b594 req-c84f3777-db25-4cf9-86c8-0d6653b314b0 service nova] Creating event network-vif-plugged:b6648bb5-3c8b-4235-b7db-d22730f77068 for instance 85bcd3d4-0eae-48e0-9877-b62bab4470b8 on hv-cinder-83124 Aug 26 16:06:56.477458 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-02805f9e-cdfb-4723-ba27-a8630285b594 req-c84f3777-db25-4cf9-86c8-0d6653b314b0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032683 Aug 26 16:06:56.478058 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 591/1176] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:06:56.740102 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-42c8aace-9bb6-4e75-bcc9-5af23af4726e tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:56.740771 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-42c8aace-9bb6-4e75-bcc9-5af23af4726e tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:56.747248 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-42c8aace-9bb6-4e75-bcc9-5af23af4726e tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:56.747735 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-42c8aace-9bb6-4e75-bcc9-5af23af4726e tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:56.750085 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-42c8aace-9bb6-4e75-bcc9-5af23af4726e tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:56.750085 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-42c8aace-9bb6-4e75-bcc9-5af23af4726e tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:56.750085 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-42c8aace-9bb6-4e75-bcc9-5af23af4726e tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:56.750085 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-42c8aace-9bb6-4e75-bcc9-5af23af4726e tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:56.940873 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-42c8aace-9bb6-4e75-bcc9-5af23af4726e tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:56.949178 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-42c8aace-9bb6-4e75-bcc9-5af23af4726e tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1575 microversion: 2.1 time: 0.213588 Aug 26 16:06:56.949752 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 586/1177] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:56 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1575 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:06:57.978343 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-c0676abe-2690-4e94-905c-58ae1c7692f8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:57.979041 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-c0676abe-2690-4e94-905c-58ae1c7692f8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:57.980984 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:06:57.986562 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c0676abe-2690-4e94-905c-58ae1c7692f8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:57.993266 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c0676abe-2690-4e94-905c-58ae1c7692f8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:57.993266 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c0676abe-2690-4e94-905c-58ae1c7692f8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:57.993266 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c0676abe-2690-4e94-905c-58ae1c7692f8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:57.993266 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c0676abe-2690-4e94-905c-58ae1c7692f8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:57.993706 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-c0676abe-2690-4e94-905c-58ae1c7692f8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:58.126365 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-c0676abe-2690-4e94-905c-58ae1c7692f8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:58.134127 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-c0676abe-2690-4e94-905c-58ae1c7692f8 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1575 microversion: 2.1 time: 0.160722 Aug 26 16:06:58.134687 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 592/1178] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:57 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:06:59.154986 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-629c4ca2-b4fe-4c72-9708-438e6ff733d7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:59.155644 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-629c4ca2-b4fe-4c72-9708-438e6ff733d7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:59.158407 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=31 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:06:59.163080 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-629c4ca2-b4fe-4c72-9708-438e6ff733d7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:59.163552 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-629c4ca2-b4fe-4c72-9708-438e6ff733d7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:59.164013 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-629c4ca2-b4fe-4c72-9708-438e6ff733d7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:59.164696 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-629c4ca2-b4fe-4c72-9708-438e6ff733d7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:59.165136 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-629c4ca2-b4fe-4c72-9708-438e6ff733d7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:59.165550 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-629c4ca2-b4fe-4c72-9708-438e6ff733d7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:59.168071 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=87 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:06:59.296457 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-629c4ca2-b4fe-4c72-9708-438e6ff733d7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:59.304394 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-629c4ca2-b4fe-4c72-9708-438e6ff733d7 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1562 microversion: 2.1 time: 0.153328 Aug 26 16:06:59.304951 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 587/1179] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:59 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:12.862827 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_api:SELECT=1 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:08:12.867762 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG dbcounter [-] [127697] Writing DB stats nova_cell1:SELECT=10 {{(pid=127697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:08:12.867762 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 16:08:12.867762 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Fri Aug 26 16:08:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 (ip 10.222.0.98) !!! Aug 26 16:08:12.869274 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [req-da32e7ae-4574-4cb6-acbb-0bf947002b8b req-f6b07904-f7fd-4d7c-b1c9-c31ed131f005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85bcd3d4-0eae-48e0-9877-b62bab4470b8", "tag": "b6648bb5-3c8b-4235-b7db-d22730f77068"}]} {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:08:12.870868 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-2e5f6c8e-a9b4-40f5-81ef-acf3949ff038 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:12.871616 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-2e5f6c8e-a9b4-40f5-81ef-acf3949ff038 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:12.875021 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_api:SELECT=1 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:08:12.877239 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG dbcounter [-] [127698] Writing DB stats nova_cell1:SELECT=5 {{(pid=127698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:08:12.878364 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 16:08:12.878501 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Fri Aug 26 16:08:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.98) !!! Aug 26 16:08:12.880604 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 16:08:12.880724 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: Fri Aug 26 16:08:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.98) !!! Aug 26 16:08:12.882053 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2e5f6c8e-a9b4-40f5-81ef-acf3949ff038 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:12.882491 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2e5f6c8e-a9b4-40f5-81ef-acf3949ff038 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:12.883929 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2e5f6c8e-a9b4-40f5-81ef-acf3949ff038 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:12.884837 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2e5f6c8e-a9b4-40f5-81ef-acf3949ff038 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:12.885502 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2e5f6c8e-a9b4-40f5-81ef-acf3949ff038 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:12.886328 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-2e5f6c8e-a9b4-40f5-81ef-acf3949ff038 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:12.901217 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-da32e7ae-4574-4cb6-acbb-0bf947002b8b req-f6b07904-f7fd-4d7c-b1c9-c31ed131f005 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:12.901699 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-da32e7ae-4574-4cb6-acbb-0bf947002b8b req-f6b07904-f7fd-4d7c-b1c9-c31ed131f005 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:12.902130 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [req-da32e7ae-4574-4cb6-acbb-0bf947002b8b req-f6b07904-f7fd-4d7c-b1c9-c31ed131f005 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:12.915504 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.compute.server_external_events [req-da32e7ae-4574-4cb6-acbb-0bf947002b8b req-f6b07904-f7fd-4d7c-b1c9-c31ed131f005 service nova] Creating event network-changed:b6648bb5-3c8b-4235-b7db-d22730f77068 for instance 85bcd3d4-0eae-48e0-9877-b62bab4470b8 on hv-cinder-83124 Aug 26 16:08:12.917579 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-2e5f6c8e-a9b4-40f5-81ef-acf3949ff038 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Going to try to terminate instance {{(pid=127697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:08:12.922751 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [req-da32e7ae-4574-4cb6-acbb-0bf947002b8b req-f6b07904-f7fd-4d7c-b1c9-c31ed131f005 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058939 Aug 26 16:08:12.923713 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 588/1180] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:08:13.355526 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-2e5f6c8e-a9b4-40f5-81ef-acf3949ff038 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "DELETE /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 204 len: 0 microversion: 2.1 time: 0.494120 Aug 26 16:08:13.356397 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 593/1181] 10.222.0.98 () {58 vars in 1239 bytes} [Fri Aug 26 16:08:12 2022] DELETE /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:08:13.367460 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-25d301fc-fb13-4e50-90e5-0441bd3bd81c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:13.371027 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-25d301fc-fb13-4e50-90e5-0441bd3bd81c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:13.378435 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-25d301fc-fb13-4e50-90e5-0441bd3bd81c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:13.379569 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-25d301fc-fb13-4e50-90e5-0441bd3bd81c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:13.380473 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-25d301fc-fb13-4e50-90e5-0441bd3bd81c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:13.381783 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-25d301fc-fb13-4e50-90e5-0441bd3bd81c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:13.382660 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-25d301fc-fb13-4e50-90e5-0441bd3bd81c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:13.383504 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-25d301fc-fb13-4e50-90e5-0441bd3bd81c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:13.611811 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-25d301fc-fb13-4e50-90e5-0441bd3bd81c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:13.616771 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-25d301fc-fb13-4e50-90e5-0441bd3bd81c tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1568 microversion: 2.1 time: 0.255232 Aug 26 16:08:13.617358 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 589/1182] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:13 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:14.641631 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a8958c6f-fa52-4ef2-a127-d2d887e0f653 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:14.642685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a8958c6f-fa52-4ef2-a127-d2d887e0f653 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:14.650408 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a8958c6f-fa52-4ef2-a127-d2d887e0f653 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:14.650921 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a8958c6f-fa52-4ef2-a127-d2d887e0f653 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:14.651419 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a8958c6f-fa52-4ef2-a127-d2d887e0f653 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:14.652158 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a8958c6f-fa52-4ef2-a127-d2d887e0f653 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:14.652614 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a8958c6f-fa52-4ef2-a127-d2d887e0f653 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:14.653039 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a8958c6f-fa52-4ef2-a127-d2d887e0f653 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:14.787359 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.policy [None req-a8958c6f-fa52-4ef2-a127-d2d887e0f653 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:14.795102 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a8958c6f-fa52-4ef2-a127-d2d887e0f653 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1568 microversion: 2.1 time: 0.160788 Aug 26 16:08:14.795667 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 594/1183] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:14 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:15.816382 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-a6686bad-5644-4a63-93ae-8a9d1d9b81fa tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:15.816997 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-a6686bad-5644-4a63-93ae-8a9d1d9b81fa tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:15.824177 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a6686bad-5644-4a63-93ae-8a9d1d9b81fa tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:15.824664 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a6686bad-5644-4a63-93ae-8a9d1d9b81fa tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:15.825097 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a6686bad-5644-4a63-93ae-8a9d1d9b81fa tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:15.825786 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a6686bad-5644-4a63-93ae-8a9d1d9b81fa tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:15.826331 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a6686bad-5644-4a63-93ae-8a9d1d9b81fa tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:15.826752 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-a6686bad-5644-4a63-93ae-8a9d1d9b81fa tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:16.052094 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-a6686bad-5644-4a63-93ae-8a9d1d9b81fa tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:16.060285 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-a6686bad-5644-4a63-93ae-8a9d1d9b81fa tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1450 microversion: 2.1 time: 0.247721 Aug 26 16:08:16.061134 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 590/1184] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:15 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1450 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:16.157555 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [req-ba6143ba-77bd-445f-94be-9df9d3585aad req-a84201c8-46b6-46b9-8060-5d6b6a26f941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85bcd3d4-0eae-48e0-9877-b62bab4470b8", "name": "network-vif-deleted", "tag": "b6648bb5-3c8b-4235-b7db-d22730f77068"}]} {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:08:16.167254 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-ba6143ba-77bd-445f-94be-9df9d3585aad req-a84201c8-46b6-46b9-8060-5d6b6a26f941 service nova] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:16.167726 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-ba6143ba-77bd-445f-94be-9df9d3585aad req-a84201c8-46b6-46b9-8060-5d6b6a26f941 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:16.168198 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [req-ba6143ba-77bd-445f-94be-9df9d3585aad req-a84201c8-46b6-46b9-8060-5d6b6a26f941 service nova] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:16.179452 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.compute.server_external_events [req-ba6143ba-77bd-445f-94be-9df9d3585aad req-a84201c8-46b6-46b9-8060-5d6b6a26f941 service nova] Creating event network-vif-deleted:b6648bb5-3c8b-4235-b7db-d22730f77068 for instance 85bcd3d4-0eae-48e0-9877-b62bab4470b8 on hv-cinder-83124 Aug 26 16:08:16.184641 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [req-ba6143ba-77bd-445f-94be-9df9d3585aad req-a84201c8-46b6-46b9-8060-5d6b6a26f941 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148565 Aug 26 16:08:16.185231 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 595/1185] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Aug 26 16:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:08:17.083497 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-de43ba79-3ab4-487e-81e9-7d3ba934dfd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:17.084143 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.compute.api [None req-de43ba79-3ab4-487e-81e9-7d3ba934dfd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:17.090877 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-de43ba79-3ab4-487e-81e9-7d3ba934dfd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:17.091364 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-de43ba79-3ab4-487e-81e9-7d3ba934dfd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:17.091805 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-de43ba79-3ab4-487e-81e9-7d3ba934dfd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:17.092535 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-de43ba79-3ab4-487e-81e9-7d3ba934dfd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:17.093025 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-de43ba79-3ab4-487e-81e9-7d3ba934dfd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:17.093972 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-de43ba79-3ab4-487e-81e9-7d3ba934dfd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:17.124209 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-de43ba79-3ab4-487e-81e9-7d3ba934dfd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:17.124687 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-de43ba79-3ab4-487e-81e9-7d3ba934dfd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:17.125126 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG oslo_concurrency.lockutils [None req-de43ba79-3ab4-487e-81e9-7d3ba934dfd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:17.125571 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.objects.instance [None req-de43ba79-3ab4-487e-81e9-7d3ba934dfd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lazy-loading 'fault' on Instance uuid 85bcd3d4-0eae-48e0-9877-b62bab4470b8 {{(pid=127698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:08:17.167235 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.policy [None req-de43ba79-3ab4-487e-81e9-7d3ba934dfd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b66de0ca9674a989cac17ca80b6cbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7eea71358e140c29fa3df652ce95a6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:17.175091 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-de43ba79-3ab4-487e-81e9-7d3ba934dfd9 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 200 len: 1225 microversion: 2.1 time: 0.095496 Aug 26 16:08:17.179333 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 591/1186] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:17 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:18.197030 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a3a76061-6b5a-44a6-9173-9007f6487f34 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '>' {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:18.197728 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.compute.api [None req-a3a76061-6b5a-44a6-9173-9007f6487f34 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] [instance: 85bcd3d4-0eae-48e0-9877-b62bab4470b8] Fetching instance by UUID {{(pid=127697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:18.204804 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a3a76061-6b5a-44a6-9173-9007f6487f34 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:18.205284 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a3a76061-6b5a-44a6-9173-9007f6487f34 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:18.205719 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a3a76061-6b5a-44a6-9173-9007f6487f34 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:18.206399 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a3a76061-6b5a-44a6-9173-9007f6487f34 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Acquiring lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:18.206845 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a3a76061-6b5a-44a6-9173-9007f6487f34 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:18.207267 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG oslo_concurrency.lockutils [None req-a3a76061-6b5a-44a6-9173-9007f6487f34 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Lock "739d7cf6-45f9-4f1f-972a-0b17316ed928" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:18.220685 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.wsgi [None req-a3a76061-6b5a-44a6-9173-9007f6487f34 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] HTTP exception thrown: Instance 85bcd3d4-0eae-48e0-9877-b62bab4470b8 could not be found. Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a3a76061-6b5a-44a6-9173-9007f6487f34 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Request method failure captured: Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: request: GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 HTTP/1.1 Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept: application/json Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Accept-Encoding: identity Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Connection: close Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Length: 0 Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Content-Type: application/json Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Host: 10.222.0.98 Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: Openstack-System-Scope: None Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: User-Agent: python-urllib3/1.26.11 Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Auth-Token: gAAAAABjCO7f1ZLPA9nO1hQChhyE_DDmi-m7thjIPDlE781G-rh7tZnoXHVMFHZuoVEgVvwrW61t0AmF3obniCKddGfS-3Jc_OGGnHlahvpTNLEctguIyo9g4-O_HlgpQkfcRoccLII1UueWMGJ436pazCf-I19KbnYea2RYTWXC2EWRJkLzyr0 Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Id: None Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Domain-Name: None Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Identity-Status: Confirmed Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Is-Admin-Project: True Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Id: default Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Domain-Name: Default Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Id: b7eea71358e140c29fa3df652ce95a6b Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Project-Name: tempest-TestShelveInstance-572661868 Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Role: reader,member Aug 26 16:08:18.222303 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Roles: reader,member Aug 26 16:08:18.224197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b7eea71358e140c29fa3df652ce95a6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b7eea71358e140c29fa3df652ce95a6b", "adminURL": "http://10.222.0.98:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b7eea71358e140c29fa3df652ce95a6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b7eea71358e140c29fa3df652ce95a6b"}]}] Aug 26 16:08:18.224197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant: tempest-TestShelveInstance-572661868 Aug 26 16:08:18.224197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Id: b7eea71358e140c29fa3df652ce95a6b Aug 26 16:08:18.224197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-Tenant-Name: tempest-TestShelveInstance-572661868 Aug 26 16:08:18.224197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User: tempest-TestShelveInstance-572661868-project Aug 26 16:08:18.224197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Id: default Aug 26 16:08:18.224197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Domain-Name: Default Aug 26 16:08:18.224197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Id: 4b66de0ca9674a989cac17ca80b6cbb7 Aug 26 16:08:18.224197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: X-User-Name: tempest-TestShelveInstance-572661868-project Aug 26 16:08:18.224197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: method: > Aug 26 16:08:18.224197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: exception: Instance 85bcd3d4-0eae-48e0-9877-b62bab4470b8 could not be found. Aug 26 16:08:18.224197 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: action_args: {'id': '85bcd3d4-0eae-48e0-9877-b62bab4470b8'} Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: {{(pid=127697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85bcd3d4-0eae-48e0-9877-b62bab4470b8 could not be found. Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:08:18.225369 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85bcd3d4-0eae-48e0-9877-b62bab4470b8 could not be found. Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85bcd3d4-0eae-48e0-9877-b62bab4470b8 could not be found. Aug 26 16:08:18.227195 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: ERROR nova.api.openstack.wsgi Aug 26 16:08:18.228936 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: DEBUG nova.api.openstack.wsgi [None req-a3a76061-6b5a-44a6-9173-9007f6487f34 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Returning 404 to user: Instance 85bcd3d4-0eae-48e0-9877-b62bab4470b8 could not be found. {{(pid=127697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:08:18.228936 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: INFO nova.api.openstack.requestlog [None req-a3a76061-6b5a-44a6-9173-9007f6487f34 tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8" status: 404 len: 111 microversion: 2.1 time: 0.031417 Aug 26 16:08:18.228936 dv-cinder-831247-24-iscsi devstack@n-api.service[127697]: [pid: 127697|app: 0|req: 596/1187] 10.222.0.98 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:18 2022] GET /compute/v2.1/servers/85bcd3d4-0eae-48e0-9877-b62bab4470b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:08:18.485766 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: DEBUG nova.api.openstack.wsgi [None req-c2b2a1ad-6ba5-46cb-9c5e-ad3aaead2b6e tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] Calling method '.version_select at 0x7fbd1e0eed30>' {{(pid=127698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:18.688140 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: INFO nova.api.openstack.requestlog [None req-c2b2a1ad-6ba5-46cb-9c5e-ad3aaead2b6e tempest-TestShelveInstance-572661868 tempest-TestShelveInstance-572661868-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1827898613" status: 202 len: 0 microversion: 2.1 time: 0.206052 Aug 26 16:08:18.688748 dv-cinder-831247-24-iscsi devstack@n-api.service[127698]: [pid: 127698|app: 0|req: 592/1188] 10.222.0.98 () {58 vars in 1254 bytes} [Fri Aug 26 16:08:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1827898613 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)